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ABSTRACT 

The objectives of this study were to: (1) identify 
personnel conducting research, development, diffusion, and evaluation 
(RDDE) activities in vocational education and related fields, (2) 
collect data describing them and their jobs, and (3) perform an 
analysis of the data to characterize the current status of vocational 
RDDE personnel and their activities. The majox reason for conducting 
the study was to provide descriptive information which could be used 
to make decisions about RDDE activities and training programs. 
Questionnaire data obtained from the identified personnel showed that 
respondents classified themselves according to educational field as 
being 47.4 percent in vocational education, 18.7 percent in 
non- vocational education, and 31.4 percent part vocational and part 
non-vocational. Forty percent of the group surveyed indicated that 
they spent 25 percent or more of their time on RDDE activities, while 
no important distinctions between vocational and non-vocatiojial 
groups as to job activities and skills utilized were suggestjed, the 
most significant result of the study was found in differences amopg 
research-related job functions. Detailed responses and analyses are 
presented in narrative and tabular form. Data from the study may be 
useful in developing both preservice and in-se rvice training programs 
for RDDE personnel. (MF) 
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Chapter 1 

INTRODUCTIGN 

THE PRQBI^M AREA 

With the passage of the Elementary and Secondary Education 
Act of 1965, specifically with the provisions of Title IV of the 
Act and the amendments to the Cooperative Research Act of 1958 con- 
talned In that Title , a nation wide effort was begun to establish 
training programs for educational research and research-related 
personnel. 

Five years prior to the passage of the ESEA the Office of 
Education was spending between ten and eleven million dollars per 
year on research and research-related activities • In four of the 
five years after the passage of the ESEA the expenditures had 
approached 100 million dollars per year (Clark and Hopkins » 1969). 

The Increased spending on research activities has caused a 
demand for more trained research personnel which » unfortunately, 
has not been met by the Increased expenditures for research 
training programs (Clark and Hopkins, 1969; Gldeonse, 1969). De« 
spite the availability of over 30 million dollars for training 
research and research- related personnel, a critical shortage of 
such personnel exists. 

It Is only In the past several years that there has been a 
real concern with the failure of research training activities to 
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meet the demands for qualified personnel. This concern has manl« 
fested itself in the form of several efforts to coordinate previous 
manpoNrer studies and projections ^ present training programs » and 
future training-program planning. These efforts were in the form 
of exploratory studies to (a) locate research and research-related 
personnel 9 (b) conceptualize and defiuci more precisely the exact 
nature of educational jresearch (R) and research-related activities 
such as development^ diffusion, and evaluation (DDE), and (c) to 
determine what research, development, diffusion, evaluation, and 
other research-related personnel are like and how they are similar 
and/or different in terms of personal characteristics, training 
backgrounds. Job tasks. Job products and services, and skills and 
competencies necessary for their work. 

This study is one of several that have been conducted to 
provide information which will aid in planning further manpower 

« 

studies of educational RDOE personnel and in establishing training 
programs to meet the demand for a sufficient supply of high quality 
personnel. 

STATEMENT OF THE PROBLEM 

In discussing R, D, D, and E activities and personnel there 
exists the problem of a lack of Information about RDDE activities 
and a lack of information describing RDIX personnel conducting 
these activities in terms such as their numbers, location, personal 
tharacteristics (age, degrees, etc.). Job tasks performed, and Job- 
related skills and competencies possessed. 



The problem exists for both of the two generally defined 
educational divisions » general education and vocational education* 
Tvo recent studies (Worthen and others, 1971; Schalock and others » 
1972) have dealt with exploring the problem In general education. 
This study has focused cn providing Information about vocational 
education RDIK personnel and activities* 

SKailFICANCE OF THE PROBLEM 

There appears to be at least two reasons for obtaining 
more precise Information about RDDE activities and personnel in 
vocational education* 

Flrsty In order to assist In declslon-<aaklng concerning the 
paee at which current and future RDDE activities In vocational edu- 
cation can proceed y It is necessary to know the current manpower 

status of p onnel who have conducted, are currently conducting^ 

« 

or who might conduct such activities » with particular attention to 
their numbers, location, place of work, educational training back- 
grounds, previous work experience, present job classification (R, 
D,D, or E, etc*)» percentage time spent performing various job 
activities (R,0»D»E, etc*), present job tasks performed^ and the 
products and services produced by the job. 

Second » in order to provide adequately designed pre-servlce 
and In-servlce training programs for vocational education RDDE per- 
sonnel. It is necessary to know the status of those personnel, with 
particular emphasis placed on the job usks they perform^ knowledges/ 
skills they utilize » and their in-service training needs* 



OBJECTIVES 



The objectives of this study, then, were (a) to identify 
personnel conducting research, development, diffusion, and evalua- 
tion activities in vocational education and related fields, (b) to 
collect data describing those pr •^•>1* and their jobs, and (c) to 
provide an analysis of the which would characterize the cur- 

rent status of vocational RDDE personnel and their activities. 

Since the major reason for conducting this study was to 
provide descriptive information which could be used to make deci- 
sions about RDDE activities and training programs, hypotheses were 
not formulated. Instead, the following questions about RDDE person- 
nel and their jobs were posed: 

1. What are the general characteristics of vocational RDDE 
personnel? 

a. How many vocational RDDE personnel can be 
identified? 

b. Where are they located by address? 

c. How do they functionally classify their present 

job? 

d. What are their ages and proportions of males and 
females? 

e. What degrees do they hold? 

f. What are their majors and minors for their highest 
degree? 

g. In what professional associations do they hold 
memberships? 

h. How many years of previous work experience did they 
have in various work areas? 

i. To what extent do they agree with the jef i litions 
of research, development, vocational education, 
etc., provided by the study? 

2. What in-service training do they need? 

3. What are their jobs like? 

a. In what type of institution are they working? 

b. What relative time do they spend on various job 
activities? 

c. What products and services are produced by the job? 

d. What Job tasks do they perform on the job? 

e. What knowledges /ski lis do they use on the job? 



4. How do vocational y non-vocational » and. part vocational 
part non«vocatlonal personnel compare with regard to 
the Information collected? 

5. How do persons who classify themselves as researchers^ 
or developers y or dlf f users » or evaluators compare 
with regard to the Information collected? 

The basic asstmptlons underlying these questions are that 
(a) lists of job tasks y knowledges /ski 1 Is ^ and personal charac- 
teristics are adequate to reveal possible differences between job 
functions 9 (b) the lists used In the study are satisfactory for 
that purpose 9 and (c) the personnel surveyed can accurately describe 
and self-rate themselves and their jobs. 

LIMITATIONS 

One limitation of this study Is that the procedures em- 
ployed did not Identify the entire population of vocational RDDE 
personnel. This Is due to (1) lack of agreement about definitions 
of the terms research, development » diffusion, evaluation^ and 
vocational education (such terms being used In Identifying the 
population), (2) restrictions In the data collection procedures » 
and (3) application of a criterion defining the population In terms 
of the amount of time an Individual spends on one or more of these 
research-related activities. 

More particularly, the criterion used to define the popu- 
lation was that the Individual must have spent an average of 25% 
or more time over the past two years or during the current year 
engaging In RDDE activities • This arbitrary level was chosen 
because 25% time represented a commonly used unit of measuring work 
time and therefore provided a readily applicable standard. A more 



Important reason £or using the 257* time criterion, however, was 
based on the belief that R,D,D, and E activities are relatively 
complex, thereby requiring a reasonable amount of concentrated 
time to be devoted to them* It seemed safe to assume that those 
persons devoting 25% or more time to RDDE activities would be able 
to understand and recognize most of the tasks and knowledges /skills 
listed on the questionnaire. 

A second limitation of this study may be imposed by the 
terminology used to describe and discuss the field of educational 
research and training. The terms research and/or research-related 
personnel are used synonymously with the acronym RDDE. The use of 
any of these terms in this paper should be interpreted as referring 
to the field of education«il research as a whole and, therefore, 
includes the loosely defined job functions known as research, 
development, diffusion, and evaluation at both the professional 
and para«professional levels. 

DEFINITION^: OF IMPORTANT TERMS 

The following are the definitions of important terms used 

in the study to define the key areas of concern* 

Administration • referring to the direction, control, and manage, 
ment of an organization. 

Context - referring to the surroundings, environment, or particular 
circumstances in which things occur. 

Development - referring to "a coordinated set of activities which 
produce reliable technology" (Schalock, 1972). 

Diffusion • referring to "a coordinated set of activities which 
lead to the adoption and/or utilization of generalizable 
knowledge, reliable technology and trustworthy information" 
(Schalock, 1972). 
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Evaluation - referring to "a coordinated set of activities which 
produce trustworthy information in support of decision 
making" (Schalock, 1972). 

Field - referring to the single broad area of work of the educa- 
tional professional. 

In-service - referring to protessional training activities designed 
to up-date and up-grade j person in the knowledges and 
skills of a particular educational field and/or job function. 

Job-function - referring to the particular type of work .performed 

by an individual, such work being given a specific, descrip- 
tive title. 

Knowledges /Ski lis - referring to the accumulated facts, information, 
and truths which the mind has access to and to the ability 
to put that information to use on the Job. 

Outcome - referring to the results of some type of activity. 

Previous work experience - referring to any and all kinds of job 
functions performed prior to the present job function. 

Process - referring to all of the elements involved id activities 
to accomplish some outcome. 

Products and services - referring to the tangible physical out- 
comes, and written and verbal communication between indi- 
viduals, resulting from job functions. 

Programs - referring to the general outline and specification of a 
series of goals, procedures, results, etc. of a specified 
set of activities. 



RDM - referring to "a coordinated set of strategies which produce 

recognizable products that can be Judged as to their quality 
and contribution to the solution of an educational problem" 
(Schalock, 1972). 

Research - referring to "a coordinated set of activities which pro- 
duce reliable knowledge, that is, facts, principles, 
generalizations, theories, and laws that can stand the test 
of empirical verification" (Schalock, 1972). 

Task - referring to a specific job activity performed on the job. 

Teaching - referring to the general activities, materials, pro- 
cedures, etc. that facilitate learning. 
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Vocational education - training, retraining, or upghiding which is 
given in schools, classes, or other locations (factories, 
store front center, etc.), including field or laboratory 
work and remedial or related academic and technical 
instruction incident thereto, under public or private 
(trade schools, union programs, business and industry 
programs, etc.) supervision and control or under contract 
with a state or local education agency, and is conducted 
as part of a program designed to prepare or upgrade indi- 
viduals for gainful employment as semiskilled or skilled 
workers or technicians or sub-professionals in recognized 
occupations and in new and emerging occupations, or to 
prepare individuals for enrollment in advanced technical 
education programs, but excluding any programs to prepare 
individuals for employment in occupations generally con- 
sidered professional or which require a baccalaureate or 
higher degree. 
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Chapter 2 



LITERATURE REVIEW 
INTRODUCTION 

When reviewing tSe literature a great number of theoreti- 
cally oriented, opinion expressing, discussion-suggestion oriented 
papers were noted; only a very few 'Manpower" studies, and two 
(Schalock and others, 1972; Worthen and others, 1971) empirically 
based studies dealing with the topic of educational research and 
research -related (development, diffusion, and evaluation) personnel 
were found « 

The lack of empirical research dealing specifically with 
the topical area of this study was not a hindrance, rather, it 
reinforced the belief that studies of the type conducted are essen- 
tial to the continued development and expansion of the research 
training effort « 

The literature made evident that there has been a sequential 
development of activities dealing with the problems and programs of 
research training. That sequence of activities has gone from 
recognizing the need for national training programs, to actual 
federal legislation which provided funds for and directed the 
establishment of research training programs, to manpower studies 
dealing with quantitative needs for personnel, to the point, today, 
where it is felt that in-depth studies should be conducted to gather 
information about educational RDDE activities and personnel. 

9 
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This review of literature attempts to discuss the papers 
and studies dealing with RDDE personnel training programs as these 
programs have developed during the seven year period since the 
ESEA was passed. 

REVIEW ae THE LITERATURE 

In the 64th Yearbook of the National Society for the Study 
of Education. Part I (1965) . which dealt solely with the topic of 
Vocational Education, a chapter by George L. Brandon and Rupert N. 
Evans, '"Research In Vocational Education," mentioned the fact that 
"In addition to an effective recruitment service, the following 
(and many other development activities) may be produced: ... 2. 
Deliberate planned Instruction In research In the professional 
preparatory and ln*servlce programs of teacHer and supervisor edu«> 
cation. ... 9. Pre- and In-servlce program development of Inter- 
disciplinary research activities Including research design method- 
ology, and experimentation employed In the major disciplines and 
professions" (National Society for the Study of Education, 1965: 
271). In 1964 there was, therefore, some concern for training some 
types of personnel In vocational education In the basics of research 
processes. 

Concern for the training of educational research personnel 
was also shown at a national level by the Phi Delta Kappa Symposium 
on the 'n?ralnlng and Nature of Educational Researchers, 1965." In 
the book reporting the papers and discussions of the Symposium, the 
sixth annual Phi Delta Kappa Symposium on educational research. 
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Egon G, Cuba's sununary listed eight strategies which were avail«> 
able for improving educational research training (Cuba, 1965: 258) • 

It was probably these kinds of expressions about the need 
for educational research personnel that led to the formulation and 
passage of the Elementary and Secondary Education Act (ESEA) of 
1965 with the all important Title IV, Research Training Programs 
provisions. 

This is not to say that concern for research training was 
absent before 1964* Studies and/or papers by Lazarsfeld and Sieber 
(1%4), Stanley (1%2), Cooley (1963), Tyler and Barron (1963), 
Thistlethwaite (1962) » Drevdahl (1961), Moore (1960), Brown and 
Slater (1960) , and even as far back as Sibley (1948) , all added 
knowledge and opinions to the discussion of the entire field of 
research training. Not until 1965, however, did there appear to 
be a more concentrated effort to study the field of educational 
research training as a unified set of problems whose solutions had 
long ranging consequences for the entire conmunlty of educators. 

In 1965 Bargar and others (1965) identified and surveyed 
the educational research community. The major outcome of the study 
was the National Register of Educational Researchers (Bargar, 1966) 
which not only listed the names and addresses of educational re- 
searchers, but provided, according to one of the objectives of the 
study, ",,,a description of certain professional characteristics of 
educational researchers" (Bargar, 1966: V), The study (and 
resulting directory) was designed first, to Identify indi- 
viduals in the United States who are now engaged in or who have 
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recently engaged in research in education, and second, to obtain 
Information from these Individuals concerning their personal vita, 
educational history, professional fields and subflelds of identl* 
flcatlon, present positions and job history, and areas of research 
activity" (Bargar, 1966: V). The study (and resulting directory) 
was noteworthy because of Its effort to help solidify the educa« 
tlonal research community and eitabllsh lines of communication 
within that community which could only add to the further develop- 
ment and improvepient of educatlc^al research and educational 
researchers • 

In the years since 1965 (mainly In 1966 through 1970) a 
nuinber of studies have been conducted to Investigate the training 
of researchers and research-related personnel. All of these studies 
have focused on three areas of Investigation: 

1. characteristics of the Institutions preparing educa- 
tional research personnel (e.g., organizational 
arrangements for research, faculty conducted research, 
faculty-student Interface, and nuoibers and types of 
research personnel trained by various Institutions). 

2. characteristics of the programs for training research 
personnel provided at the Institutions offering 
"research training programs" (e.g., types of course 
work and experience^) . 

3. characteristics of the trainees participating In the 
training programs (e.g., I.Q., marital status, emo- 
tional stability, undergraduate work, degrees possessed, 
recruitment procedures, selection procedures and 
criteria, degree programs chosen, and experiences In 
other areas of research and work). 

Studies and papers dealing with the first area, Instltu^ ■ ^ 

tlonal characteristics. Include those by Buswell and others (1966) , 

Sleber (1966), Lazarsfeld and Sleber (1964), Helss (1966), 
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Brown and Slater (1960)f and Thlstlethwalt^ (1962). These studies, 
although they have added greatly to knowledge about the educational 
research comnunlty and its training programs, say nothing about 
describing the tasks which RDDE personnel perform on their Jobs as 
a means of designing training programs. Rather, they merely 
described the status of institutions at which research training 
occurs • 

Although the studies dealing with trainee characteristics 
also contributed to the knowledge about research training activi- 
ties, they too did not study actual RDDE activities. The studies, 
which include those by Taylor and Barron (1963), Cooley (1963), 
Drevdahl (1961), Moore (1960), Clark (1966), Stanley (1967), 
Buswell and others (1966), Gardner (1967), Bldwell (1967), and 
Sieber (1966) were very interesting in that they Investigated the 
characteristics of research trainees and made a number of sug« 
gestions concerning the desirable qualities of future research 
trainees as inputs to the training process. 

The last area of study, program characteristics, deals with 
the process of conducting research training programs* The work by 
KrathwoU (1965), Sieber (1966), Drevdahl (1961), and Cuba (1965) 
aptly described the process of research training programs, but did 
not link them to what goes on out in the "real world" of actual 
RDUE activities « 

As can be seen, a number of the studies noted (e.g., 
Drevd^l (1961), Clark (1966) , Buswell and others (1966), Sieber 
(1966)) ovetlap the tiiree areas of investigation. What is missing 



14 

from the total picture, however, are studies of the Input, process 
and product relationships* 

Looking more closely at some of the reports mentioned above, 
It Is possible to discern the beginning of the sequence of thought 
about how the field of educational research training might be 
further studied ami developed. 

Sleber (1966) mentlcmed in passing that ''experience*' (as 
opposed to text teaching) is an important consideration in training 
research personnel, but he did not say how one would go about 
finding out ^at kinds of "experience" are essential to producing 
a "good" researcher. 

Buswell and others (1966) studied research personnel who 
obtained doctorates between the years 1954 and 1964 and gathered 
information about their location, type of work, opinions about 
research, etc., but, as others, they did not gather information 
about the types of tasks these people performed in their work, nor 
the types of knowledges ^skills they possessed. 

Clark's (1966) paper was one of the first to mention that 
the educational comminity must somehow learn more about the educa«. 
tional research process and about educational researchers. He stated 
that all trainers of researchers should be knowledgeable about 
research and^ research-related processes. Regarding research 
training programs, he stated quite frankly, ''Every research planner 
has to face questions of program objectives, student selection, and 
program elements and experiences either explicitly or implicitly 
and we have been too willing to settle for the latter" (Clark, 
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1966: 89) • Here, for the first time, was an Implication that the 
educational research comunity must take an explicit, detailed 
look at research and research training activities. 

-In 1967 a very brief, but comprehensive, discussion of the 
preparation of research personnel for education was published 
Jointly by Fhi Delta Kappa and the American Educational Research 
Association (Clark and Worthen, 1967). The discussion and presen- 
tation hit upon most of the problesns of educational research 
training, but as with most other studie* and discussions, it failed 
to indicate what effect knowledge about the actual activities of 
RDDG personnel might have on solving some of the problems of 
research training* 

It was in early 1969 that the real challenge for research 
activities dealing with research training was made. Fleury and 
otiiers (1969) indicated in their report of a study of research 
trainees (as of 9/1/66) that "There is a paucity of research on 
research training. The published research studies are descriptive 
of practices of schools of education which relate to the production 
of educational researchers and to research productivity of such 
personnel" (Fleury and others, 1969: 10). Although their study 
dealt with entrance requirements and success in completing research 
training programs, the call was made for more and more encompassing 
research on research training. 

As is often the case, when a call is made for more research 
in an area in which little has been done previously, someone is 
usually already at work on it. In 1969 the well-known Clark and 
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Hopkins study of research, development, and diffusion manpover was 
published and shoved the extent to which other studies could be 
made to add to and expand the voluminous knowledge compiled by it* 

One of the original objectives of the study was to "Identify 
existing and emerging roles and required skills atid behavior for 
research and research«related personnel in education" (Clark and 
Hopkins, 1969: 5)« This objective, however essential it was (and 
currently is) to determine the nature of training programs^ was 
deleted from the study* Instead, the study had to "•••deemphasize 
the delineation of skills and behaviors requisite to the roles and 
substitute for this a much more detailed manpower resource pro- 
jection* Such information seemed more useful for planning and ^ 
decision making purposes, particularly at a national level" (Clark 
and Hopkins » 1969: 8). 

It was unfortunate that the study did not undertake a de- 
lineation of skills and behaviors, but that type of Investigation 
was put off until recently when other studies have attempted to 
provide such information* The Clark and Hopkins study did, how- 
ever, pro'fide a great deal of manpower information based on then 
current numbers of research, development, and diffusion personnel 
and projected funding levels for RDD activities* Their projections 
estimated that the "demand for trained R, D, and D personnel in 
1974 was likely to be five times the 1964 demand* In other words, 
there would be a demand for about 19,000 ROD personnel in 1974 as 
compared with 4,000 personnel in 1964* Even their least likely 
projection of three times as many personnel (e*g*, 12,000) gave an 
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indication of the need for more research training efforts and the 
implication that more imist be learned about research training pro« 
grams if they are to meet that demand efficiently • 

It should be noted that th^ Clark and Hopkins projections 
were based mainly on previous patterns for funding educational 
research as compared with projected funding patterns • The more 
recent study by Worthen and others (1971) updated the Clark and 
Hopkins projections for 1974 RDDE manpower. In light of changes in 
funding patterns for RDDE activities many of the assumptions on 
which those earlier projections had been made were invalidated* 
Thus, the newer projection estimated that the demand would be only 
two times as great (8,250) as the number of ROD personnel found in 
1964 (4,125) • Even with the current projections there still appears 
to be a demand for research dealing with research training if the 
qualitative outputs of the programs are to be satisfactory and the 
programs are to be efficient* 

In the Bargar and others (1970) study, mention was made of 
training programs, knowledges and skills or skills competencies 
needed, and behaviors related to RDDE tasks or activities, but no 
discussion was provided concerning how the competencies were deter« 
mined • 

The most encompassing discussion about the need to study 
research training came in 1970 with the publi;!;ation of a paper by 
Cuba and Gephart* The following series of quotes from that paper 
clearly reveal the current status of knowledge about RDDE training* 



Discussing the overall program of RDDE activities In edu- 

cation^ Guba and Gephart stated: 

Funding Is Indeed as Important as an Input In the system 
that generates knowledge about education and converts 
It to practice. Of equal importance are personnel, the 
human agents of the system who Invent, develop, and 
implement Ideas for change and improvement. A fairly 
large ntonber of personnel to guide and participate In 
educational Improvement must be recruited and trained 
If the available funds are to have the desired Impact 
(pp. 2). 

In regard to the RDDE personnel situation they stated: 

The current personnel and personnel training situation 
In the research, development, diffusion, and evaluation 
(RDD 6e E) areas can be characterized as desperate. This 
Is true because of: 

1 . Existing shortages . . . 

2. Insufficient numbers being trained ... 

3. Gaps In existing research training ... 

4 . Lack of middlemen training programs . . . 

5. Lack of training materials and trainers ... (pp. 2-4). 

The authors went on to say that: 

Efforts to mount RDDE programs are likely to flounder 
on two counts. First, very few substantive data are 
available regarding the gaps and deficiencies In 
existing traditional educational research training 
programs and very little Is known about the nature and 
needs of emergent educational development, diffusion, 
and evaluation roles (pp. 4) « 

In summing up the description of their Generation and Con« 

version of Knowledge to Educational Practice (GCKEP) model, the 

authors stated; 

Legitimate questions have been raised about the quality 
and effectiveness of research training. How many solid 
empirical studies have been done on the skills needed 
to engage In research? (pp. 60) . 

A long range goals part of the system Includes a general 

category goal of studies which will delineate the nature 

of the research and research«»related processes, the 

settings In which they are appropriate, and the skills 

and knowledge needed for engaging In those processes (pp. 71) • 
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•••additional studies need to be commissioned to fully 
establish the set (or sets) of needed skills and 
knowledge (pp^ 72) • 

Their call for more studies about research and research- 
related processes was based on the underlying thesis: 

•••that knowledge of the research and research-related 
processes, the skills necessary for participating in 
them, and the means for creating those skills has been 
accumulated through unsystematically analyzed experi- 
ence and through logical analysis • Empirical 
documentation is required and should be generated by 
a long term targeted research and development program 
(Cuba and Gephart, 1970: 76). 

Clearly Cuba and Gephart hit the proverbial nail on the head 
When they indicated a need for the research community to take an 
empirical look at itself and its training programs in order to pro- 
vide properly trained personnel • 

In developing a functional competence training program for 
DD and E professional and paraprofessional personnel. Hood and 
others (1970) further stated the case for the essential need to do 
on-the-job (or in the actual or real world) studies of RDDE per- 
sonnel in order to make training programs realistic • They stated, 
"Ideally, for maximal instructional efficiency, the elements in the 
curriculum and in the real world should correspond one to one, while 
the training course as actually taught should cover some portion of 
them^^^" (Hood and others, 1970: E 2)^ They also stated, "Only 
training objectives which are established in direct response to the 
results of a job or t&sk analysis will provide a firm, job oriented 
basis for the development of a training program (Hood and others, 
1970: E 1)^ Clearly, the need for going into the world of work 
of RpEE personnel and studying them and their activities is 
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Indicated as a necessity to realistic training programs for such 
personnel* 

In late 1970 two proposals for just the type of research 
activities called for by Cuba and Gephart (1970) and Fleury and 
others (1969) were submitted to the United States Office of Edu« 
cation. Both of these proposals ^ which resulted in two very recent 
reports which are not yet generally available (Worthen and others » 
1971; Schalock and others, 1972) » had as major objectives the 
determination of the tasks of RDDE activities and the determination 
of the skills and knowledges or competencies that research and 
research«related personnel need in order to perform RDIffi activities. 

The proposal for the Uorthen study stated » "Lack of ^owl- 
edges about 'training variables* is undoubtedly the greatest impedi* 
ment to planning training programs that will not only provide 
sufficient initial training to researchers and related personnel 
but also provide sufficient in-service training to prevent 
obsolescence and continually upgrade skills" (Worthen and Byers^ 
1970: Appendix J» pp, 6), 

It is unfortunate that the final reports from the Colorado 
(Worthen and others » 1971) ao*^ Oregon (Schalock and others » 1972) 
projects are not yet available for review. In two very brief 
papers (Worthen » 1972 and Ammerman^ 1972) presented at the 1972 
American Educational Research Association (AERA) Convention both 
the Colorado and Oregon studies reported their methodology » sample » 
and general types of data collected » and also indicated that it 
would be necessary to read the reports to get the total picture of 
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the results of their studies. All they could generally indicate 
was the fact that new insights into RDDE activities » personnel, 
and training programs had been gained which should be very bene- 
ficial to improving RDDE training* 

Other papers delivered at the 1972 AERA cotf&ention (Heathers 
and others, 1972; Hood, 1972; and Ward, 1972) all indicated a need 
to study job tasks and knowledges/skills or competencies of RDDE 
personnel and activities in the world of work as a means of gaining 
better understanding of the nature of RDDE training programs, 

SUMMARY 

In summarizing the literature, it is apparent that there 
has been a sequential development of ideas and actions concerning 
the field of educational research, development, diffusion, and 
evaluation activities, personnel, and, since 1965, training pro- 
grams* From the stage of discussing RDDE activities and who were 
performing such activities, to the stage of developing training 
programs, through the present stage of discussing and studying 
RDDE activities, the central theme has been a desire to acquire 
more and better empirical information that will tie training 
efforts to the actual needs of the field* As a result, the edu« 
cational RDDE community should be able to confidently state what 
it is doing, using well defined and accepted terminology, it should 
be certain that what is is doing is consistent with the overall 
goals and problems of the national educational system, and it 
should be confident that the training programs it provides are 
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consistent with the quantitative and the qualitative needs o£ the 
real world of work of RDDE activities. 

The literature reviewed supports the idea that the RDDE 
comminity is gradually advancing its knowledge about its own 
activities and personnel and, in so doing, contributing greatly 
to the Improvement of RDDE training programs. 



Chapter 3 



DESIGN OF THE STUDY 



POPIIUTIOM IDENTIFICATION 



In order to identify a population of vocational education 
RDDE personnel (generally thought to be approximately four hundred 
in number), several methods were employed* 

First, 167 letters were sent (and several phone calls made) 

requesting individuals at the types of institutions listed below 

to identify the names and addresses of as many people as they could 

who they believed had conducted or were conducting BLUE activities 

in vocational education. 

1* USOE Bureaus, Divisions, and Branches 

2* State Departments of Education (Vocational-Technical 

Division, and Research Divisions) 
3« State Research Coordinating Units for Vocational 

Education 
4« Regional Laboratories 

5« The Center for Vocational and Technical Education 
and the North Carolina Center for Occupational 
Education 

6« Professional Education Associations (e«g«, AERA and 

its Significant Interest Group on Vocational Education; 
American Vocational Educational Research Association) 

7« Private Foundations (e«g«. Ford, Kettering) 

8* Business and Industry Foundations, Associations, and 
Corporations (e«g«. Rand, AIR) 

9« Colleges and Universities 

10* U« S* Department of Labor, and National Science 
Foundation 

11* Other miscellaneous organizations and persons* 
A copy of the general format of the letter sent to persons in the 

listed institutions is found in Appendix A* 

23 
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No definitions of R, D, D, or E were given to direct and/ 
or limit the response of the person contacted* Instead, It was 
assumed that the general, broadly used definitions of R, D, D, and 
E would be understood by those persons contacted and thereby would 
allow them more latitude In Identifying Individuals conducting RDDE 
activities than would have been possible If stricter, narrower 
definitions had been provided • 

The second method of Identifying the study population was 

to review research Indexes to Identify names of Individuals who had 

recently completed an RDDE activity In vocational education* The 

publications consulted were the following: 

1* Manpower Research Reports , U« S« Department of Labor 
2. Dissertation Abstracts 

3* Research In Education (RIE), ERIC Central 

4. Abstracts of Research and Related Materials In Voca* 
tlonal and Technical Education (ARM), ERIC Vocational- 
Technical Education Clearinghouse* 

5. Abstracts of Instructional Materials In Vocational 
and Technical Education (ADO, ERIC Vocational- 
Technical Education Clearln^ouse 

6* Selected reviews, syntheses and bibliographies of 
research, development, diffusion, and evaluation 
activities In vocational education. 

Since many of the documents listed In these publications were 

reporting projects whose results happened. Incidentally, to be of 

Interest to vocational education, many authors would probably not 

be classified as vocational WVE personnel for the purposes of this 

study* The difficult part of reviewing these publications, 

especially the ARM and AIM publications, was making the decision 

about whether or not tr€' persons Identified should be classified 

as vocational education aI^DE personnel* 
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Selecting persons to be Included in the population in this 
manner would have been extremely difficult had it not been for the 
fact that duplication of names in these publications, when compared 
with the names obtained from other sources which more positively 
identified individuals as vocational education RDDE personnel, cut 
the nuoiber of decisions down considerably* 

A third method of identifying the population was to obtain 
a list of personnel conducting USOE funded projects dealing with 
vocational education RDIK acti^ties. 

Finally, the fourth method of identifying the population 
more completely was to request those persons identified by the 
previously mentioned three methods to complete question twenty-> 
seven on the mailed survey questionnaire and indicate the names and 
addresses of any persons they knew in their Immediate geographic 
area who were spending 25% or more time on vocational RDDE activi- 
ties. This fourth method of identifying a population was employed 
since the investigator believed that knowledge about who is doing 
what in local geographic areas is best known to persons in that 
area* 

SURVEY QUESTIONMAIRE ITEM IDEWTIFICATIOH . 
PILOT STDDY, AND FINALIZED PpMAT 

Item Identification 

In order to determine the questionnaire items that might 
be used to gather information about the personal background, Jobs, 
and training needs of active vocational RDDE personnel (and answer 
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the questions set by this study in Chapter 1) a review of recent 
papers and studies which had collected the following kinds of 
Information was made: 

1. age and sex 

2. degrees held 9 and majors and minors of highest degree 

3. association memberships 

4. types and years of previous work experiences 

5. places of employment 

6. classification of Job function and educational field 

7. tasks performed on the Job 

8. knowledges /skills possessed and /or used on the job 

9. products and services produced by the job 
10. ln»servlce training needs 

The greatest help in Identifying types of Items was obtained from 
reviewing the In-progress work of the Oregon (Schalock and others » 
1972) and Colorado (Worthen and others » 1971) studies since they 
dealt directly with the types of Information this study sought to 
gather. The large majority of task and knowledges /skills Items 
finally utilized In this study came from those two projects » with 
other questionnaire Items being fonnilated by the Investigator as 
needed to aid In class Ifjrlng and describing the vocational educa- 
tion population. 

The Items from the Colorado and Oregon projects were 
probably far superior to any lists of Items the Investigator could 
have constructed Independently since these studies had theoretically 
determined tasks and knowledges /ski lis lists and empirically tested 
those lists* In addition » by utilizing many of the same Items » the 
results of the three studies may better be compared. 

Note should be taken of the fact that the content of this 
study was to deal with vocational education RDK personnel and not 
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with general education KOBE personnel as did the Colorado and 
Oregon studies • Eoiiever, since the Investigator assumed that the 
activities Involved In R, D, D, and E (If not their relative 
emphases) spanned the "differences" between the vocational and 
n in« vocational education fields, the use of tasks and knowledges/ 
skills lists designed for studies of non« vocational RDDE personnel 
could quite appropriately and properly be used In the study of 
vocational RDDB personnel. Before actively utilizing Items from 
the Colorado and Oregon projects, however, the lists of tasks, 
knowledges/skills, and other questionnaire variables were clrcu* 
lated among a pilot stucfy group (described In the next section) of 
vocational personnel fov their comments, suggestions, criticisms, 
and additions In order to Insure an Inclusive set of tasks, etc, 
relevant to vocational RDDE lictlvltles. 

Note should also be taken that the Investigator advanced 
no hypotheses concerning the relationship between tasks performed 
and knowledges /skills utilized. Although relationships should 
exist between tasks performed and the knowledges /skills requisite 
to performing those tasks. It was not the purpose of this study 
to Investigate that relationship. 

Pilot Study 

A pilot study Involving the participation of sixteen voca« 
tlonsrl education RODE personnel In the Mlimeapolls«St, Paul, 
Minnesota metropolitan area and several out-of-state persons was 
conducted to determine the effectiveness of the cover letter and 
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the fifteen page survey instrument designed to collect the data 
about vocational education RDDE personnel and their jobs. 

The participants In the pilot study were requested to 
review the documents and to make any comments they wished regarding 
pertinent changes and/or additions to Improve the questionnaire's 
clarity » format » Instructions » style » 1 terns » variables » etc. The 
coonents from this group were utilized to create an Instrument 
which would most effectively achieve the objectives of the study. 

Finalized Format 

TWO final forms of the questionnaire » one long- form (Appen- 
dix B) and one short-form (Appendix D) » along with the necessary 
cover letters » Instructions » and retum«mail procedures and mate- 
rial were developed • 

The long-form questionnaire (15 pages) was aent as the 
first attempt to collect data. After a post-card reminder-to- 
participate was sent as a first follow-up» the second follow-up 
consisted of sending the short-form questionnaire (9 pages) # The 
short-form questionnaire was utilized as a means of collecting data 
from non-respondents who may not have completed the long-form 
questionnaire primarily because of a lack of time to participate 
and/or interest in the survey. 

This procedure is a departure from standard survey method- 
ology. The short-form questionnaire, did not collect as much data 
as one mi^t like» but it did obtain data which helped to identify 
and classify the population under study; also» the method helped 
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to account for members of the pofmlatloa, thereby making any 
Inferences about the total population more accurate* 

In addition to the two mailed survey questionnaires » a 
telephone Interview schedule was constructed. (See Appendix E for 
an example of the Interview sdiedule*) This was used by a tele- 
phone Interviewer calling a stratified random sample of non« 
respondents • The Interview schedule collected data which 
classified non«respondents and described a few of their basic 
characteristics (e^g*, highest degree held, place of work. Job 
function 9 and educational field) • 

BATA COLLECTION 

The data collection procedures for this study consisted of 
the five phases described below, 

Ihase I 

After Identification of a potential population consisting 
of 1,568 persons 9 the fifteen page, long-form questionnaire and 
cover letter (see Appendix B for examples) along with a first-class, 
buslness«reply envelope (9 x 11 manlla) were sent via first class 
mall to that group* The persons receiving the survey questionnaire 
were asked to complete It according to the Instructions provided 
and to return It within one week* 

The questionnaires were sent December 6, 1971* 
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Phase II 

Five weeks after the mailing of the long-form questionnaire 
a second mailing of that questionnaire ^ utilizing the same proce- 
dures as outlined In Phase I^ above ^ was made. In this phase of 
data collection the group consisted of 394 new persons who had been 
nominated (as persons spending 25Z or more time on RDOE) by those 
persons responding to the Chase I mailing within the five week 
period^ December 10» 1971 to January 10» 1972. 

The questionnaires for the Phase II mailing were sent 
January 10 » 1972, 

Phase III 

Six weeks after the mailing In Phase I^ a follow-up 
reminder-to-par tlclpate postcard (see Appendix C for au example) 
was sent to all those persons on the Phase I mailing list who had 
not responded. This mailing consisted of a first-class mall post- 
card reminding them of the questionnaire sent to them and urging 
them to participate In the study by completing the qMestlonnalre^ 
or at least sending back the return mall envelop^ with a note Indi- 
cating that they did not wish to participate In the study. The 
postcard was sent to approximately 900 non-respondents of tae 1^568 
persons on the Chase I mailing list. Postcards were not sent to 
any of the persons on the Phase II mailing list because of the 
recency of mailing the questionnaire to them. 

The postcards were sent January 14» 1972, 
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Phase IV 

Eleven weeks after the Phase I mailing, six weeks after the 
Phase II mailing, and five weeks after the Riase III mailing, the 
follow-up, nine page, short«form questionnaire and cover letter 
(see Appendix D for examples), along with a return envelope, were 
mailed to all those persons from the Phase I and the Phase II 
mailing lists who had not responded to the questionnaire and/or 
follow-up postcard. Approximately 1,000 follow-up questionnaires 
were sent to non-respondents from the combined Phase I and Phase II 
mailing lists, which totaled 1,962 persons. 

The short-form questionnaires were sent February 18, 1972, 

Phase V 

The deadline for data to be analyzed was set at nineteen 
weeks after the original mailing of the Riase I, long-form question- 
naire and eight weeks after the mailing of the Phase IV follow-up, 
short- form questionnaire. 

During the weeks after the data return deadline, a strati- 
fied (by state) random sample of one hundred (100) non-respondents 
from the combined Phase I and Phase II mailing lists was selected 
to contain two non-respondents from each state. This sample of 
non-respondents was then interviewed by telephone in order to 
gather some data describing the characteristics thought essential 
to classify non-respondents, A sample of the telephone interview 
questionnaire is found in Appendix E, Sixty-four (64%) of the 
sample of 100 were Interviewed, Thirty-six of the sample were no 



32 

longer at the location phone and could not be traced to a new 
location • 

The data return deadline was April 14, 1972. The phone 
Interviews were conducted April 17 through May 12, 1972* 

Phases I to V; Working Rules 

During the potential population Identification and data 
collection phases of the study, the essence of the ground rules was 
tfimply that every reasonable effort would be made to correctly 
Identify persons name, title, and location and that If the orlg« 
Inal Identification prociss was In error every reasonable effort 
would be made to correct It. 

Given the fact that the Identification of the potential 
population took place In August through October, 1971, the mailing 
lists should not have been out-of-date to any great extent. If 
the addresses were out«of«d&te. however. It was believed that the 
first-class mailing procedures assured forwarding to a new address. 
Any mall returned as being non«forwardable or as addressed to some- 
one at a particular Institution who was no longer there, unknown, 
and/or whose present 'View" whereabouts were unknown, caused the 
person addressed to be classified as non-locatable. No further 
attempt was made to locate that person. 

If a person could not be located by phone because he or she 
was no longer at a particular Institution and could not be traced 
to a *H:iew" location, that person was also classified as non- 
loca table . 
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Although these ground rules caused approximately 210 of 
the total identified potential population of 1,962 to be classified 
as non-loca table, and ruled out any further attempt to reach them, 
it was necessary to do this given the time, personnel, and finan* 
cial constraints of the study, and the extr^^ difficulty of 
locating people who could not be found by the forwarding of first- 
class mail method and/or by using colleagues with whom, and 
institutions at which, they previously worked to identify their 
new whereal 'Uts, 



Chapter 4 
DAIA ANALYSIS 
INTRODUCTION 

In analyzing the data resulting from the procedures out- 
lined In Chapter 3, three methods were utilized. This chapter 
describes these three data analysis methods. 

The statistical analyses described In Methods I and II were 
performed by using the Statistical Package for the Social Sciences 
(Nle and others, 1970) computer programs (MARGINALS and CODEBOOK 
programs for Method I and FASTABS program for Method II) . 

The University of Minnesota Computer Center (UCC), Control 
Data Corporation (CDC) 6600 series computer was used to analyze the 
data* 

The analysis described In Method III was performed by the 
United States Department of Defense, Marine Corps, Computerized 
Occupational Data ^alysls Programs (COTAP) (Oats-Hllls Consultants, 
1970) utilizing an IBM 360 series computer. 

In discussing the analyses of data, the term variable 
(abbreviated VAR and followed by a 3 digit number) will be used to 
refer to specific Items on the questionnaire. Reference to Item 
numbers on the questionnaire Is made with each variable number since 
variable numbers were assigned for analysis procedures only and 
were not Indicated on the questionnaire . Reference should be made 
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to Appendix F for a complete cross reference of questionnaire 
Itemsy the names of variables ^ and data analysis variable Identi- 
fication nimibers (VAR ^ ^ ^ • 

METHODS C3F ANALYSIS 

Method I 

This method consisted of obtaining a descriptive enitmera- 
tlon of the responses to variables which required only a numerical 
response or the checking of a response ^ and excluded write-ins. 
The enumerations consisted of frequency counts ^ and relative and 
cumulative percentages. In addition^ whenever It was appropriate 
(e.g., for age, years of previous work experience, agreement with 
definitions), means, modes, medians, ranges, standard deviations 
and variances were computed. 

Method I was used on all the variables In the study as a 
means of examining the characteristics of the distribution of 
responses. 

Method II 

This method consisted of performing cross-tabulations or 
producing contingency tables. For example, the method cross- 
tabulated the responses to variable 49 (question 16) with the 
responses to the TASK variable 59 (question 20.A.1). 

The contingency tables or cross-tabulation matrixes pro« 
vlded for each cell the raw frequency count, row percents, column 
percents, and percent of total, and also provided the marginal 
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totals and percents. (See Appendix G for an example of a typical 
cross-tabulation table output.) 

In addition to the display of data provided by this method 
of analysis, statistical tests were performed on the table data 
to determine the probability of obtaining the observed distribution 
of responses among the table cells based on the distribution one 
would expect from the marginal totals • The statistical test em- 
ployed In this case was the Pearson Chi Square test of association* 
It tested the Independence (or lack of statistical association) 
between the two variables being cross-tabulated. (See Appendix H 
for statistical formulas.) The test was applied to all contin- 
gency tables whenever frequency counts permitted (e.g., all cells 
had expected frequencies greater than 5). For 2x2 tables, the 
Yates' corrected Chl»square was applied. If there were fewer than 
21 cases In the 2x2 tables, Fisher's exact test was utilized* 

The cross- tabulation and Chl-square analysis method was 
mainly applied to those variables dealing with tasks and 
knowledges/skills (VAR 059 to VAR 239), although the method was 
also applied to other nominal data In order to identify and compare 
some of the characteristics of response groups (e.g., vocational 
researchers, non-vocational researchers, etc.). 

The level of significance chosen for the Chl-square tests 
was the conventional .05 level (reported as p2C.050). 

Method III 

The third method of analysis consisted of what might be 
called Job duty and task clustering or grouping processes. For a 
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detailed explanation of the mathematlcal-computerlzed method used 
consult the CODAP manual (Oats-iHllls Consultants, 1970).^ The 
CCXIAF system has been mainly used by the United States Armed Forces 
to provide Job description Information for their personnel training 
programs for various Armed Forces Jobs, 

The system utilizes a hl^ speed computer to produce an 
optimum solution for a hierarchical structure of Job duties and 
tasks as defined by the Investigator • "In CODAP, a solution Is 
one which Identifies a Job, that Is separates the work Into posi- 
tions requiring various constituent duties, tasks and elements, Indl*- 
eating the scope of the tasks encompassed and distinguishing a given 
Job from all other Jobs to some desired degree. The result Is 
called a Job description* What the computer cannot do Is tell 
whether the Job descriptions are good or bad except In relationship 
to other established scales of Judgement, Hence, final evaluat4.on 
Is essentially a human action rather than a computf».rlzed fact" 
(Oat8-€llls Consultants, 1970: 1-2), 

SUMHABY 

Both the Chl«square and CODAP analyses were utilized to 
provide evidence showing relationships and/or differences between 
the response groups (e«g«, vocational, non«voc«tlonal, research, 

^For those Interested In the concepts of clustering and the appli- 
cations of the CODAP system they are referred to: Department of 
the Air Force, Air Force Human Resources Laboratory (AFSC) , 
Occupational Researdi Branch, Personnel Research Division, Lack- 
land AFB, Texas 78236, Attn: HRPO, for complete listing of 
AEHRL publications. 
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dlffusloa^ 6tc,), These analyses were performed in order to pro- 
vide evidence vhlch mlg^t indicate the existence of distinguishing 
characteristics which could possibly be used to classify and dif- 
ferentiate among job functions and job fields, as well as to define 
tasks and knowledges/skills clusters for the various job functions 
and job field groups « 



Chapter 5 
FIMDINGS 

Seven sections are used to report the actual data from 
the study. The first section presents the results of locating the 
vocational RDDE group and response rates. The second section 
describes and compares the response group's general (personal) 
characteristics. The third section describes and compares the In- 
service training needs of the response groups. The fourth section 
describes and compares the job description data^ while the fifth 
section describes and compares the job tasks and knowledges/skills 
data. The sixth section reports the results of the clustering 
analysis of tasks and knowledges /skills variables. Finally » the 
seventh section reports the non-respondent telephone Interview data. 

NOTES ABOUT T^JI£S 

Firsts note should be made before reading any of the 
tables that any discrepancies between the number of respondents 
reported for "all respondents" and those reported for various sub- 
classifications (e.g.» vocational^ non-vocational » vocational 
research » etc.) ware due to incei^late cespoasea to ttama on the 
questionnaire • Items not completed were classified as missing 
data. 

The following example should help clarify the reasons for 
the discrepancies. If the responses to^ three variables ware 
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VAR-A - 1, VAR-B - 2, VAR-C - no response, then the data were 
accounted for in the folloiflng manner: 



All Respondents Counted as 
Tabulations Response 


Counted as 
Missing Data 


VAR-A X 
VAR.B X 
VAR-C 


X 


Cross-Tabulation Tables 
Involving the Three Variables 


VAR.A X VAR-B X 

VAR.A X VAR-C 

VAR-B X VAR-G 
* 


X* 
X* 



Even though the respondent has a response to VARS A 
and B, he will not be counted as a response in any 
cross-tabulations involving VAR-C since he did not 
respond to that iten* 

Second, tvo tables in the sections dealing with respondent's 
characteristics, in-service training, and Job descriptions were 
used to sunmarize the data and to shov the results of the analyses 
performed for each of the variables listed in those sections « The 
first table in each pair sunnarlzed the data for all respondents 
(N"786) classified by educational field « The second table pre- 
sented a sunnary of the data which more directly focuses on the 
major concerns of this study; that is, the data were reported for 
only respondents who classified themselves as either researchers, 
developers, diffusers, or evaluators from either the vocational or 
the non-vocational educational fields (M«212)« 

Because of insufficient numbers of respondents and/or the 
likelihood of respondents answering more than one category in the 
item, statistical tests were not applied to the data about age 
(Table 8), degrees held (Tables 9 and 10), major for highest 
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degree (Tables 11 and 12), minors for highest degree (Tables 13 
and 14), professional organization memberships (Tables 15 and 16), 
years of previous work experience (Table 18), agreement with defi- 
nitions (Table 20), In-servlce training needs (Tables 23 and 24), 
place of work (Tables 25 and 26) , percent time on present Job 
activities (Table 28), and job products and services (Tables 29 
and 30) • However , the summarized data are presented In the tables , 
and 8 brief subjective eicamlnatlon of those data Is presented In 
the text accompanying the tables. 

In reporting the data, the main concern was Its relation- 
ship to questions 16 (VAR049) and 17 (VAR050). These Items classi- 
fied respondents by Job functions (e.g.» research, development, 
etc,) and by educational field (e.g., vocational, non-vocational, 
etc,). The major emphases of the study were to describe the popu- 
lation which perforoied various job functions In vocational education 
and to compare these persons across job functions and with persons 
In the non-vocational fields. 

KSCRIPTIOM OF THE GROUP SURVEYED 

Locating the Group 

One-hundred and sixty-seven letters requesting the names 
and addresses of persons conducting RDOE activities In vocational 
education were sent. There were 91 responses (a 34% response 
rate) to this letter (see Appendix A for sample letter) • The 
nuad>ers of responses from the different resource groups utilized 
are shown In Table 1. 
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TABLE 1 

XABUIATION OF RESPONSES TO NAME-SEARCHING LETTER 





Letters 


Responses 




Special Organizations 


7 


6 


85 


RCU Directors 


48 


31 


64 


Associations 


45 


26 


57 


State Departments 
of Education 


54 


23 , 


43 


Special Persons 


13 


5 


38 


Total 


167 


91 


54.4 



The responses fron all resource groups was quite hl^^ 
given the nature of the request. It should be noted that all 
responses did not necessarily provide names and addresses » but In 
most cases an Indication of where one might seek such names and 
addresses was given. 

From the response* letters to the request for names and ad* 
dresses and from the search of various publications » organizational 
mailing lists » and funded projects lists ^ a group of 1^568 persons 
possibly engaged In vocational education RDIffi activities was 
Identified • 

A second » additional list of vocational education RDM! 
personnel was made In January^ 1972 after receiving 665 returned 
questionnaires from the first mailing of 1^568 • Some of those 665 
responses listed » as requested by question 27 » the names and 



addresses of persons in their geographical area who were spending 
25% or more tiae on RDK activities. From the names provided an 
additional 394 persons, not on the original list of 1,568 persons, 
were Identified and Included In the group surveyed. 

- The total group Identified by this study, then, consisted 
of 1,962 persona who^ at least potentially, were engaged In voca- 
tional education RDDE activities. All 1,962 persons were surveyed 
by the study. 

In the group surveyed, over 33% came from the following 
states: Ohio (102), Mew York (92), California (79), Pennsylvania 
(75), Florida (71), North Carolina (65), Wisconsin (57), New 
Jersey (27), and Texas (23). As Is readily seen, the distribution 
of personnel Identified as being active in vocational education 
RDDE is quite diverse across the United States. 

Survey Response Rates 

As of May 31, 1972, 1,253 persons (63.9%) of the total 
identified group surveyed of 1,962 had been accounted for in some 
manner. Seven-hundred and eighty«six (62.7%) of the 1,253 persons 
indicated they spent 25% or more time on RDIS activities and, 
therefore, provided on the mailed questionnaires data about them- 
selves and their Jobs, while 344 persons (27.5%) indicated they 
spent less than 25% on RDDE activities and, therefore, provided no 
data. An additional 43 persons indicated a desire not to parti« 
cipate in the study, while 16 more returned the questionnaire after 
the deadline for accepting data. In a subsequent telephone survey 
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of 100 non-respondents 64 provided a small amount of data. This 
total group of 1^253 persons was classified as the "accounted for" 
part of the group surveyed* 

The remaining 709 persons (36.1%) In the total group sur- 
veyed were classified as "not accounted for". No Information about 
this group was collected. Two-hundred and ten (10.7%) of those not 
accounted for were not located by any direct method such as for* 
warding of first class mall or by telephone number referral. Four- 
himdred and nlnety«nlne persons gave no response whatsoever. 

The response rates to the survey were considered reasonable 
given the fact that both questionnaires were lengthy (the original^ 
long*form questionnaire Involved nearly one hour of time to com- 
plete) . 

Table 2 (see following page) presents the accounting of the 
total group surveyed* 

(HABACTERISTICS OF RESPOWDENTS 

The first table to present data describing the character- 
istics of the respondents shows how they classified themselves 
according to Job functions and educational fields variables » VAR049 
and VAR050» respectively. Table 3 Indicates that a large number 
of respondents classified themselves as persons performing a 
combination of Job functions. It was not surprising to find that a 
large number of persons who spent 25 percent or more time in 
research-related activities indicated they performed a mix of 
R» and E Job functions as well as administrative and 
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teaching functions, given the nature and variety of places where 
RDDE activities usually occur. 

Table 4 presents the job function and educational field 
cross-tabulations for only persons who specialized In either 
research, development, diffusion, or evaluation In vocational or 
non-vocational fields. 

Chl-square analysis of data In Table 3 (test of Indepen- 
dence) Indicated no statistically significant relationship between 
the job function variable and the educational field variable. 
Analysis of the data In Table 4 Indicated no statistically signi- 
ficant relationship between the R, D, D, or E job functions and the 
vocational and non-vocational education fields. 

The major emphases of this study focused upon RDDE functions 
within the vocational education field and between the vocational 
and non-vocational education fields. The numbers of respondents 
shown In Table 3, however, who performed combinations of functions 
In all three educational fields as well as the numbers of respon- 
dents who classified themselves as partly In vocational education 
and partly In non-vocational education fields should not be 
Ignored. Consequently the Investigator performed two generalized 
analyses of the personal characteristics of the respondents. 
First, utilizing all respondents who perform research-related 
functions 25 percent or more time (N^786) , their characteristics 
were summarized by and comparisons were made between educational 
fields, with all job functions (e.g. research, development, 
teaching) collapsed. Second, the personal characteristics of only 



49 

the respondents who classified themselves as eitKer researchera, 
developers, diffusers, or evaluators from either the vocational 
or the non-vocational fields were summarized (N-212) . 

Tables 5 and 6 present the distribution of males and 
females in the response group (question 9, VAR002). Table 5 shows 
the data for the three educational fields and all respondents. 
The Chi-square test indicated a significant (p».013) relationship 
between the sex of the respondents and their educational field. 
It seems quite evident that the majority of respondents in all 
three fields were males but that vocational educators had a higher 
proportion of females than the other fields. 

Table 6 presents the sex data for only the RDDE job func- 
tions within vocational and non-vocational fields. No statistically 
significant relationship was found between sex and the four job 
functions. It is interesting to note that for research, develop- 
ment, and evaluation functions there was a heavy male dominance of 
3 to 1 for both vocational and non-vocational fields, but that in 
diffusion work the ratio approached 1 to 1 in both fields. 

Tables 7 and 8 show the data on age of respondents (ques- 
tion 10, VAR003). An analysis of variance test of the data in 
Table 7 indicated no significant differences In mean ages of 
respondents from the different educational fields. Inspection of 
the data in Table 8 from RDDE personnel in vocational and non« 
vocational fields, showed a surprisingly Wde range of ages, from 
22 to 72 years, with mean ages from 33.8 to 41.7 years, median 
ages from 31.3 to 43.7, and modal ages from 28.0 to 46.0« But 
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although a good deal of variability existed within each category, 
the mean ages of researchers , developers , dlffusers, and evaluators 
appeared to be similar to each other. 

Tables 9 and 10 present the data describing degrees held 
(question 11 , VAR004 to VAROll). The question requested the 
respondent to check all degrees held, but apparently this ques* 
tlon was misunderstood and many who checked holding a doctorate 
did not Indicate that they also held a master's or a bachelor's 
degree. Nevertheless , It Is clear that a majority of the respon- 
dents held doctorates. Both Tables 9 and 10 reveal that a greater 
proportion of the non-vocational RDDE personnel held the doctorate 
degree than did vocational KDDE personnel. On the other hand, there 
seems to be very little difference in either field in the propor- 
tion who held the doctorate and were researchers, developers, 
dlffusers, or evaluators* 

With regard to majors for the hlgihest degree held (question 
13, VAR023), Table 11 shows that, not unexpectedly, a higher per- 
cent of vocational education personnel specialized in vocational 
education training, while in the ncm-vocational and part vocational 
part non«»vocational fields, the greatest percent of personnel 
majored in educational administration and psychology* 

For the vocational and non-vocational RDDE personnel only. 
Table 12 indicates that vocational personnel were trained mainly 
in vocational education, teaching, and administration, while the 
non-vocational personnel were trained mainly in psychology, admin- 
istration, research, and teaching* This general pattern appears 
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TABLE XI 

HAJ0R3 FOR }IICH£$r V^CHEi VCH ALL RCSPOMDCTfTS 
BY ALL EDUCATIONAL FIELDS 



Ma lor 


Voc 
(n-373) 


NOQ 

Voc 
{n«U7) 


Pirt Voc 

Son Voc 
<n«247) 


Staciacfcot 
Pro'c«bititr 
Valuvf 


All* 
RostiOiMlaota 

01-784) 


E4ucati9n/Teachiiig 


50 
13* 5X 


13 
8.91 


t8 

1 m 31m 


No futu 
^rforaod. 

iMijCCiciont 
nu=b«r of 
rcspoodofita. 


83 


Educacion/Adniniatration 


57 


24 


49 


135 
17.3X 


Cduc ■ t i on / Rb ■ • ■ rc h 


25 
6*7X 


17 


23 

Z±1S 


66 
. 8.41 


Edttcotiofi/Curric«t«B 


19 


13 


16 

0*9* 


50 
6.41 


Guldoncc /Ceufiso t ii^ 


22 


10' 


20 




53 
6.81 


Voeotlosat Edycotioii 


102 
27. 5Z 


1 

.71 


20 
8.11 




123 
15.71 


S e« t i ■ t Lc ■ /Moo ■uCMMOt/ 
Toiti 


3 

.n 


12 
8.21 


8 

3.31 




23 
2.91 


Ftychotofy 


70 
5.41 


25 
17. IZ 


39 
15.91 




85 

10.91 


Sociology 


4 
l.ll 


3 

2.11 


3 

1.21 




10 
U31 


Bntinoorluf 


2 
.51 


2 

1.41 


8 

3.n 




13 
l.TX 


Cosfutor Seioncoa 


1 - 








1 
.IX 


Eogliih'Writlos 


4 
1.11 


1 

.71 


4 

1.61^ 


9 

1.2^ 


HoMnltloo 


2 
.51 


2 

1.41 


4 
1.81 




8 

t.Ol 


BusiMii Adainiitrotioo 


3 

.81 


1 

.71 


2 

••^ 




6 

.81 


Fhyiieot Sei«!i£ca 


3 

.81 




4 
1.61 




7 

.91 


Biatoficot ScUneoi 


4 

1.11 


1 

.71 






5 

.61 


Induitriot RttoCiOM 






1 

.41 




1 
.11 


Othor 


50 
13.5% 


21 
14.41 


22 
8.91 




104 
11.31 


Hiaaine Ooto 


2 

.51 


1 




1 

.41 




4 



^Includta 19 vho did not IndUoto on oditcotlonit fiold* 
!*■ or« of re«Ftettv« coIimi n'a* 



{ 
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to hold true between RDDE job functions within each field, with 
the exception that for vocational researchers and non- vocational 
evaluators a higher proportion than usual were trained In research* 

Tables 13 and 14 show the summary of data collected 
regarding minors for the highest degree held (question 14, VAR024 
to VAR041), Table 13 Indicates that, for all respondents, tiie 
most popular minors for vocational personnel were vocational edu« 
cation, educational administration, teaching, and research • For 
non- vocational personnel, s tatls tics /measurement , research, and 
psychology were most popular, while administration, research, and 
teaching were the most popular minors of part vocational part non« 
vocational personnel • 

Table 14 reveals that among the non-vocational RDDE person- 
nel the largest percent took their minors In subjects not listed 
In the table (77.1% **other*0 > with statistics, research, teaching, 
and psychology following In that order* The most popular minors 
for vocational RDDE personnel, on the other hand, were research, 
followed by "other", and then vocational education and admlnlstra- 
tlon* 

Tables 15 and 16 show the data describing professional 
organization memberships (question 12, VAR012 to VAR022)* Table 
15 Indicates that for all respondents by educational field a larger 
number of vocational personnel belonged to the AVA and AVERA than did 
non-vocational personnel, while more of the latter tended to Join 
AERA and the APA» Membership In the other associations appeared 
to be fairly evenly spread across all three educational fields. 



TABLB t3 



HXNOXS FOR HIGHEST DECREZ FOR ALt RESPONDENTS 
BY ALL EDUaTtONAL FIELDS 



Hinor 


Voc 
(n.373) 


Non 
Voc 
(n.K7) 


Part Voc 
Part 

Non Voc 
(n»247) 


S^-atLitical 

r c wvm o ft • ft 

' Valuos 


All* 

(Il»7d6) 


Education /Taachint 


69 
18.SX 


16 

10.9X 


48 

19.47, 


No taata 


137 
17, 4X 


Cducation/Adminiat ration 


76 

20.9X 


14 
9.57. 


124 
S0.2X 


pcrfomad 

due to 
possibility 


126 

u,ox 


Cducation/aeaoorch 


69 
18.SX 


27 
18,4Z 


SI 
20.6X 


of r#ABaiii#A 
btiag in 


ISO 
19, IX 


Education/Curricutua 


49 
13.1X 


12 
8.2X 


36 
15.4* 


mora than 
ona 

Hinor 
category. 


102 
13,0X 


Guidanca /Cbunao t ing 


34 
9. IX 


3.4X 


10 

6.5X 


36 
7. IX 


Vocational Education 


82 

22, OX 


2 

1.4X 


17 
6.9X 


103 
13.^ 


S ta t La tica /Moaauroactt 
Taata 


46 

12, n 


30 
20. 4X 


k\ 
16.6X 




121 
IS.4X 


Faychology 


37 
8.6X 


2S 
17. OX 


35 
14. 2X 




93 
11.3X 


Sociology 


27 
7.2X 


S 

3.4X 


13 
5.3X 




45 

5,7X 


Enf inaarini 


12 
3.21 


2 

1.4X 


10 
4.0X 


23 
3.2X 


Cevputor Sciancaa 


11 
2.9X 


6 

4.U 


6 
2.4X 




23 
2.9X 


Engliah/tfrittnt 


13 
3.SX 


6 

4. IX 


6 

2.4X 




26 

3,3X 


HuMnitiaa 


12 
3.2X 


I 

.7X 


11 
4.5X 




24 
3. IX 


Buain«ag Adatntatration 


16 
4.3X 


6 

4. IX 


15 
6. IX 




37 
4,7X 


Phyaical Scioncaa 


7 

1,9X 


2 

1.4X 


7 
2,6X 


21 
2.?^ 


Biological Sctancaa ^ 


11 

2.n 


4, IX 


4 

1.6X 


21 
2.7X 


Industrial Kolationa 


6 

l,6X 




7 

7.8X 




14 
1.8X 


Othar 


72 
19. 3X 


31 

21. r 


46 
16.6X 




136 
19.8X 



Sncludaa 19 who did !iot tndicata an oducational fiald. 



X*a arc of raap«ctii« coluan fi*ai 



TABU 14 



MINOftS POR niCHEST DECREE OF RESPONDENTS FOR R, D, D, AND E FUNCTtOK 
WITHIN VOCATIONAL AND I^ON-X'OCATIOKAL FIELDS ONLY 

(N ■ 212) 



Minor 


fteaaarch 




ipincnt 


Diffusion 


Evaluation 


Sub-T'>tal^ 


Total* 


Voc 


Non 
Voc 


Voc 


Non 
Voc 


Voc 


Kon 
Voc 




Non 
Voc 


Voc 


Kon 
Voc 


Education/Teaching 


















22 
14. IZ 


8 

14. OX 


30 

14.11 


EducatLon/AdniaUtratiOfi 


















24 
15.41 


8.71 


29 

13.61 


Education/Rtaaarch 


















33 

2U2t 


9 

15.71 


42 

19.81 


Education/Curricutu* 


















19 

12.2% 


5 

8.71 


24 

It. 31 


Cu Ida oca /Cou na a 1 i ng 


11 
















15 

9.6Z 


2 

3.51 


17 

. 


Vocational Education > 


















24 

15.41 




24 

11.31 


Staciatica/Heaaurancnt 
Teata 


















23 

14.81 


10 
17. 5^ 


33 


Faychology 


















13 

8.31 


8 

14.07. 


21 

9.91 


Sociology 


















tl 

7.11 




tt 

5.11 


Enginaaring 


















5 

3.21 


2 

3.51 


7 

3.31 


Computar Scicncaa 


















4 


3 

5.21 


7 

3.31 


Engliah/tfriting 


















4 

2.51 


3 

5.21 


7 

.. Wl 


HMMntttea 


















5 

3.21 




5 


Buainaca Adnintatratton 


















7 

4.51 


2 


9 


Phvaical Sciancaa 


















1 

.61 




t 


Biological Sciancaa 


















5 

3.21 




2.3; 


Induatrial Ralationa 


















2 

1.21 




2 


Othar 


11 












4 




27 

17.41 


44 

77.11 




Ntinbcr in Group 


51 


22 


60 


17 


19 


3 


25 


15 


155 
"l 


57 
"2 


2t2 
9 



1. l*a ara of or 02 

2. l*a ara of N 



TABLE IS 

PROFESSIONAL ORGANIZATION HEMBeRSHlPS FOR 
ALL RESPOMDSNTS BY ALL EDUCATIONAL FIELDS 



Orttntzteton 


Voc 
(n-373) 




Psrc Voc 
Psrt 

Non voc 
(n-247) 


Ststlstlesl 
ProtMblllty 
Vslucs 


All* 
RespoAdonts 

CN«7e6) 


ABRA 


33. 2X 


80 

54.41 


90 
36.4X 


No tests 
perfontd 


298 
37.9X 


NBA 


6S 

VM 


31 
2t.U 


55 
22. 3X 


duo to 
possibility 
of r«spoQS«s 


156 
19. 6X 


AVA 


289 

77. 5X 


tl 
7,5X 


82 

33. 2X 


being in 
wort thsQ 
on* 


388 

49.4X 


APGA 


22 
3.9X 


14 
9.5X 


22 
8.9X 


Assoc istion 
cstsfory. 


59 
7.5X 


APA 


16 
4.31 


37 
25. 2X 


45 
18. 2X 




99 
12.6X 


AECT 


$ 

2.1X 


6 

4. IX 


10 
4.0X 




24 
3. IX 


AIAA 


37 
9.9X 


5 

3,4X 


19 

7.7X 




62 
7.W 


AVSRA 


147 
39.4X 


4 
2.7X 


47 
19.0t 




200 
25.4X 


POK 


173 
46.4X 


60 
40. 8X 


109 
44. IX 




339 
43. IX 


Ocbtrt 


282 
75.6% 


146 
99, 3X 


185 
74.9X 




632 
80.4X 



^Includos 19 vha did not indies to on odoeotional fiold. 
X's art of rospoctivo eolum 
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Under the "other" association a total of 210 organizations were 
lis ted y ranging from what appeared to be fraternities to Asian 
and African student organizations* 

Table 16 presents the data concerning only vocational and 
non-vocational RDIS personnel. Here. too , between the vocational 
and non-vocational groups , proportionally more vocational person- 
nel held memberships In organizations directly oriented toward 
vocational education (AVA, AVERA, AIAA), while proportionally more 
non-vocational personnel held memberships In organizations directly 
oriented toward non- vocational education (AFGA, APA) « The asso- 
ciations covering the more general aspects of the total field of 
education (AERA, MEA, FDK) were Indicated as associations to which 
proportionally more equal nimibers of vocational and non-vocational 
personnel belonged. Except that a large proportion of vocational 
developers belonged to the NEA than ml^t be expected ^ there 
seemed to be uo other differences between vocational researchers , 
developers y dlf f users , and .evaluators In terms of the professional 
associations to which they belong. 

Tables 17 and 18 present the data describing years of 
experience In work areas (question 15, VAR042 to VAR048), Table 
17 shows that for all respondents by educational field » with the 
exception of previous work experience In RDK activities , the 
persons In all three educational fields showed similar mean number 
of years In the remaining work areas. In the RDIK work area voca« 
tlonal personnel had significantly fewer mean years of experience 
than non-vocational personnel and part vocational part non-vocational 
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personnel* Apparently RDDE activities In the non-vocational field 
have been going on for a longer period of time than such activities 
In vocational education • 

No glaring differences In average number of years spent In 
previous work areas were revealed In Table 18 between vocational 
and non-vocational personnel. It Is Interesting to note that 
researchers have spent more time In "other educational employment" 
than persons In the other three job functions. Other Interesting 
differences In mean number of years experience were indicated 
between vocational and non*vocatlonal developers for "other non* 
professional employment"; between vocational and non-vocational 
dlffusers for "administration", "teaching", "other educational 
employment", and "present position" work experience (although 
these differences may be strongly Influenced by the small number 
of non-vocational dlffusers) ; and between vocational and non- 
vocational e valuators for "administration" work experience. 

Tables 19 and 20 provide a simmary of the data concerning 
the respondents' agreement with the definitions provided by the 
study (question 25, VAR269 to VAR274), Table 19 shows that for all 
respondents by educational fl^ld there were, between the three 
fields, statistically significant differences in the mean agree- 
ment with the definitions for research, development, and diffusion, 
but similar mean agreement ratings for all other definitions. 
Vocational educators showe'l a significantly lower mean agreement 
rating for the definitions of development and diffusion than ^e 
other two fields, while non*vocatlonal educators had a lower mnan 



TABLE 19 



ACXEEMEVr WITH DEnSITIOKS FOft ALL RESPOHDBinS 
n ALL Eir:CATX(»IAL nCLDS** 



Dafinltiofif 


Voc 
(«.373> 


Hon 

Voc 
(0-147) 


Part Voc 
Part 

Noo Voc 
{tt-247) 


Statiatical 
Probability 
Valuaa 


All* 
laapondaata 

(K-786) 


Km 


i - 3.90 
• • 1.B76 

o • 347 


X - 3.90 
a - 1.921 
a - 133 


X • 3.80 
a • 1.920 
a - 225 


F - 1.41 
p • >.05 


X • 3.8^ 
a - .75 

a -723 


ISMarch 


i -4.06 
• • 1.953 
B • 346 


X - 2.5S 
a • 2.025 
4-134 


X -4.03 
a • 1.994 
a • 230 


F • 49.S2 
f - <.0l 


X - 4.05 
a • .76 
a -728 


Htm lofMMt 


X • 2.96 
a • 1.927 
n • 346 


X • 3.91 
a - 1.955 
ji - 134 


X - 3.69 
a • 1.963 
a • 229 


r • 35.08 
p • <.01 


X - 3.94 
a - .80 
a - 729 




X - 2.97 
a - 1.664 
r. • 348 


X - 3.90 
a - l.Svl 
a • 133 


X • 3.82 
m - 1.933 
a - 228 


r - 18.7 

p • < .01 


X • 3.83 
a - .83 
a - 726 


tvalMtlM 
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a • 347 
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a - 1.9?0 
• - 134 


X • 4.01 
a - 1.993 
a • 229 


r - .886 

p - > .05 


X -4.01 
a • .82 
a - 728 


VoeatiOMl 
BJtatiOM 


X - 3.93 
a • 1.H6 

o • 347 


X - 3.71 
a - 1.899 
a - 132 


X - 3.71 
a * 1.948 
a • 229 


r • 4.13 

p • > .05 


X - 3.81 
a - .99 

a - 726 




X - 3.93 
a • 1.957 
• *34l 


X - 3.87 
a - 1.927 
a - 134 


X • 3.96 
a - 1.953 
a - 229 


f - .595 
P - > .05 


X - 3.93 
a • .82 

a m 723 
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agreement rating for the definition of research than did the other 
two fields. 

Table 20 indicates that between RDDE Job function groups 
and between vocational and non-vocational educational tields there 
was a reasonably high degree of agreement with the definitions of 
the terms and with each other. This group, whose members considered 
themselves either researchers, developers, diff users, or evalua- 
tors, had a higher degree of comnon understanding about the 
definitions of these functions than did respondents who performed 
other or Joint functions. 

This section has reported the data collected describing 
the respondents in terms of the general (personal) characteristics 
of sex, age, degrees held, majors, minors, association member- 
ships, previous work experience, and agreement with definitions 
about educational RDDE. The data were shown for all respondents, 
with specific breakdown between educational fields, and for Just 
those respondents ^o performed R, D, D, and E functions within 
vocational and non-vocational fields only. 

The next section presents data describing the in-service 
training needs of the survey respondents. 

IN-SERVICE TRAINING 

The same two general types of analyses were performed 
with in-service training data as were performed with general 
(personal) characteristics data. That is, first the three educa- 
tional fields (vocational, non-vocational, and part vocational 



part non-vocational) were compared after collapsing all job func* * 
tlons (N»786) • Second, the data from only the respondents who 
classified themselves as either vocational or non-vocational 
researchers y developers, diffusers, or evaluators were summarized 
(N-212) • 

Table 21 presents the data about recent in-service parti- 
cipation (question 24, VAR268) for all respondents (N-786) , while 
Table 23 presents the data about their present expressed In- 
service training needs (question 23, VAR257 to VAR267)« Table 21 
shows that there was no algnficant relationship between educational 
field and whether or not the respondent had participated the past- 
year in in-service training* In Table 23, it is interesting to 
note that a fairly large percent of the combined respondents ex- 
pressed a current need for all kinds of in-service training, but 
that non- vocational personnel appeared to have less of a need for 
almost all areas of training than did the vocational group* 

Tables 22 and 24 present the in-service training data for 
the vocational and non-vocational RDDE personnel only. Table 22 
shows that between vocational and non-vocational groups similar 
proportions of persons participated in past-year in-service 
training* When educational fields were collapsed a statistically 
significant relationship (as measured by the Chi-square test of 
independence) was found between the yes or no answer to the 
participation in in-service training variable and the job func- 
tions classification variable* A high proportion of evaluators 
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took In-servlce training while much lover proportions o£ re- 
searchers , developers y and dlffusers took training. 

Table 24 Indicates that a £ ilrly high percent of both the 
vocational and the non-vocational RDDE respondents specified all 
training areas as perceived In-service training needs. As in 
Table 23 for all respondents , the teaching/training techniques 
In-servlce area was the least In demand. Between vocational and 
non-vocational and and £ respondents there were no 

striking differences noted In the proportions of each expressing 
an In-servlce training need. 



The following section provides a description of the char- 
acteristics of the jobs performed by survey respondents. The data 
for the general descriptive itiformatlon about location of employ- 



products-servlces produced Is, again, presented by two types of 
tables. The first presents data for all survey respondents (N«786)y 
while the second presents data for R, and E functions within 

the vocational and non-vocational fields only (N«212) . 

In terms of place of work (question 19, VAROSS), Tables 25 
and 26 show the employment location of the respondents. In Table 
25 the largest percent of all respondents (37.3%) were employed 
by Universities 9 while smaller proportions were In State Education 
Departments (14.5%), R&D Centers (11.0%) » and K«12 School 



JOB DESCRIPTIONS 




menty pereent time spent on viirlous job activities , and job 
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PUC£ OP WORK FOR ALL RSSPONOEKTS 
BY ALL EDUCATIOtlAL FIELDS 
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^Includes 19 who did not Indicete en educational field. 
X*s are of respective coluan ii*e. 
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Districts (9.3%). This pattern was not unlike the pattern for 
vocational and non-vocatlcnal fields. 

Inspection of the data in Table 26 Indicates that, whereas 
a proportionally greater number of vocational than non-vocational 
education personnel were located at technical institutes, R&D 
centers, RCUs, and federal agencies, the uon-vocatlonal respon- 
dents were mainly occupying positions at independent research 
agencies, and state departments. 

Berveen Job functions for both vocational and non-vocational 
personnel. Table 26 reveals that researchers and developers were 
located mainly In universities, R&D centers, RCUs, and state 
departments of education* In addition, a sizeable proportion of 
developers were located In K*12 school districts* Dlff users were 
mainly located In universities, R&D centers, and professional 
education associations, but evaluators were located mainly in 
state education agencies* 

Tables 27 and 28 show the data about percent time spent on 
listed current activities (question 18, VAR051 to VAR057) . Table 
27 shows the data for all respondents by educational field. No 
statistically significant differences (as measured by the analysis 
of variance) were found between the educational fields in terms 
of the mean scale ratings of percent time spent on Job activities. 
The respondents from the three categories of educational cleld 
were spending approximately the same amount of time in each 
activity area. The ranking of activities in terms of decreasing 
mean percent time spent on them by all respondents was as follows: 
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«Y ALL K£S?O t iP E HTS m ALL EDUCATIONAL FIEUIS** 



Job ActiviCV 


Voc 
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Voc 
(n-l47) 


Port Voc 
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s - 1.98 

n - 247 


P • .228 
» « > .05 


X - 1.99 
• - 2.16 
a - 786 


DovotopMfit 


i • 2.22 
s - 2.41 
n m 373 


X - 1.98 

9 m 4*44 

n - 147 


X - 1.81 
s - 2.M 

n - 2U1 


F - 1.971 
p - > .05 


X - 1.97 
9 « 2.94 
a - 786 


DtfflMlM 


i • o.« 

s - 1.48 
n « 373 


X * O.M 
f - 1.10 
n - U7 


X • 0.97 
s - 1.48 

n - 247 


P - 1.659 
P - > .05 


X - .88 

a - 1.55 
a - 786 


Evotuatton 


i - 1.32 
f « 2.27 
n . 373 


X - 1.67 
9 - 2.33 
e - 147 


X " 1.54 
s - 1.67 
n - 547 


P « 3.599 

p - > .05 


X - 1.42 
• • 2.24 
a - 786 


Tooch ing/Tro In ing 


i - 1.46 
s • 2.20 
n • 373 


X - 1.72 
s - 2.11 
n • t47 


X - 1.44 
s • 2.02 
n • 247 


P - .933 
p • > .05 


X - 1.49 
t - 2.10 
a - 786 


Administrattoa/ 


X - 2.30 
• • 2.55 
n - 373 


X - 2.24 
f - 2.54 
« - 147 


X - 2.50 
s - 2.50 
n - 247 


P - .646 
p « > .05 


X - 2.35 
a - 2.39 
a - 786 


Other 
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administration/management; teaching/ training; development; re- 
search; evaluation; diffusion; and other. The highest average 
time spent was 21% to 30Z on Administration/Management activities. 
The most often indicated (modal) percent time spent on each of 
the activities was 1% to lOZ time. Twenty-nine types of dif- 
ferent activities were listed by respondents under "other". 

Table 28 shows predictable results indicating that 
researchers spent most of their time doing research work 9 devel- 
opers doing development work, etc. The Job activity categories 
defined the Job function title or vice-versa. It is equally 
apparent, however, that Job activities were more varied than job 
function titles indicated; researchers, for example, tended to 
spend time in other research-related activities as well as in non- 
research related activities* Vocational personnel did not differ 
from non-vocational personnel in this regard. 

Table 29 and 30 present the data describing Job products 
and services rendered (question 22, VAR240 to VAR256) . Table 29 
indicates that for all of the respondents by educational field, 
the most frequently (50% or more indicating a Jcb outcome) pro- 
duced products and services were reports (85.2%), consultation 
(73.2%), workshops/conferences (70.2%), proposals (67.5%), and 
proposal writing/ reviewing (63. 9Z). The least frequently produced 
products and services were books (19.2%), newletters (30.5%), and 
tests (32.8%). 

Table 30 reveals that vocational and non-vocational RDDE 
personnel had similar major products and services (e.g., reports. 
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JOB PRODUCTS AND SERVICES FOR ALL 
RESPONDEOTS EY All EOUCATIOKAl PieUIS 
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JOB PAOOUCTS AND SSmCES OF RESPONOESTS FOR R, 0, 0, AND B PWCTIOHS 
WITHIN VOCATIONAL AND NOM- VOCATIONAL FIELDS ONLY 

(N - 212) 





Rciearch 


Development 


Diffusion 


evaluation 


•?ub-Total* 


Total 2 


Producta-Scrvlcci 


Voc 


Nofi 
Voc 


Voc 


Non 
Voc 


Voc 


Non 
Voc 


Voc 


Non 
Vvw 


Voc 


Noo 
Voc 


letter* 


14 


3 


17 




11 




6 


2 


48 

30.9^. 


11 
19. 3X 


59 
27.8X 


Raporta 


43 


16 


50 




13 




23 


15 


129 
B3.27. 


48 

84. 2X 


177 
63.4X 


Bibliographies 


13 


8 


17 




13 




4 


6 


47 

30.3t 


23 
43. 8X 


72 
33.9X 


Boolta 


7 


4 


8 




4 




2 


3 


21 

13.57. 


?l 

19. 3X 


32 

15.0X 


Currlculua 
Haterieli 


25 


4 


14 




5 




8 


3 


52 
33.57. 


16 
28. OX 


68 

32.0X 


Hcchodolotlea 


24 


13 


29 




4 




11 


8 


43 


31 

54. 3X 


99 
46. 7X 


Teata 


U 


8 


21 








7 


7 


28. n 


15 
26. 3X 


59 

27. 8X 


PropoieU 


35 


14 


33 




8 




12 


6 


83 

56.77. 


29 

50.8X 


117 
55. IX 


Training Paekagea 


21 


7 


26 




I 




4 


7 


52 
33.5^. 


22 

38.6X 


74 
34.9% 


Conaultatiofi 


36 


14 


42 




12 




17 


9 


107 
69.C*» 


34 

59.6X 


141 
66. 5X 


Survey Design/ 
Conductinc 


23 


8 


18 




3 




15 


8 


59 


21 

36. 8X 


80 

37.7X 


Propoaal Reviev/ 

Writliw 


29 


12 


34 




9 




15 


9 


87 

56. IT 


32 

57. 8X 


119 
56. IX 


Vorkahopa/ 
Conferencca 


30 


11 


41 




11 




10 


10 


92 

59.3% 


33 

57. 8X 


125 
58. 9X 


Other 


3 




S 




2 




I 


2 


14 

9.0*. 


6 

10, 5X 


20 

9.4X 


Kunber in Grot ^ 


51 


22 


60 




19 




25 


15 


155 
•l 


57 
"2 


212 
> 



1. X'a ere of n^ or n. 

2. X'a ere of II 



consultation, workshops) , but that they differed In the less Impor- 
tant products and services; proportionally more vocational edu- 
cators tended to produce newsletters, while proportionally more 
non«vocatlonal personnel turned out tests, bibliographies, and 
methodologies. 

Within the vocational personnel, researchers, developers, 
dlff users, and evaluators appeared to provide similar services and 
produce similar types of products, except that dlff users had 
greater (rank-order) output of newsletters and bibliographies, and 
evaluators were more apt to design and conduct surveys than person- 
nel In the other research-related functions • 

JOB TASKS AND KNOWLEDGES /SKILLS 

Perhaps the most^^mportant data collected by the study 
dealt with the job tasks performed and the knowledges /skills 
utilized by respondents, since these data have the most direct 
implication for training personnel. 

It should be emphasized that the data reported in this 
section were based on the frequency distributions of responses to 
each task and knowledge /ski 11 variable. The actual data collected 
were on scales ranging from 0 to 5 (tasks) and 0 to 4 (knowledges/ 
skills). It was felt, however, that as collected, the data would 
not be justified as interval mea£ures, and as ordinal measures 
the data would not lend themselves to relevant analyses. There- 
fore, the 0 to 5 and 0 to 4 scales data were collapsed to a two 



point scale, 0 (do not perform or utilize) and 1 (perform or 
utilize), for the analyses of job tasks and knowledges /skills data. 

Previous analyses of personal characteristics, in-service 
training, and job description data indicated that there were very 
few meaningful differences to be found between the vocational and 
the non-vocational fields within each research-related job func- 
tion. Therefore, in order to check this finding further, the 
task and knowledge/skill data were first analyzed to compare 
vocational researchers with non-vocational researchers, voca- 
tional developers with noa*vocational developers, etc., for each 
research-related job function for each task and knowledge /skill • 
Chi-square contingency tables were utilized to make the tests of 
independence. The analyses revealed statistically significant 
Chi-square values (p£«05) for only variables 92 and 179 when 
examining researchers; only variable 61 when examining diffusers; 
and just variable 127 when examining evaluators. No variables 
were found to be significant when developers were examined. Thus, 
it appeared that there were few differences between fields within 
each research-related job function in terms of tasks performed or 
knowledges /skills utilized. 

Given this knowledge of similarity within function, the 
educational fields were collapsed in order to make analysis among 
research-related job functions possible. Table 31 presents the 
numbers of respondents from the vocational, non-vocational, and 
part vocational part non-vocational fields who were combined 
within each research-related job function. (It was assumed that 
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If respondents from the vocational and the non-vocational fields 
were similar, then those performing In both fields at once would 
not be different from either group.) 

TABI£ 31 

Nl]MBERS OF RESPONDENTS IN R, D, D, AND E JOB FUNCTI(»I 
GROUPS FOR TASK AND KNOWLEDGE /SKILL 





CHI< 


•SQUARE DATA 


ANALYSIS 






Research 


Development 


Diffusion 


Evaluation] 


1 Total 


Voc Ed 


51 


60 


19 


25 


155 


Non-Voc Ed 


22 


17 


3 


15 


57 


Part Voc Ed 
Part Non-Voc Ed 


30 


29 


4 






Total in Job 
Function Group 
Analyzed 


103 


106 


26 


■ 


L 


Table 32 


presents 


the results 


of aniilyzi 


Lng the data fron 



the tasks performed It^ (question 20, VAR059 to VAR137) and the 
knowledges /skills utilized Item (question 21, VAR138 to VAR239). 
Ghl^square tests of Independence were performed to test the rela- 
tionship between research-related job functions and whether or not 
each task was performed and knowledge/skill utilized. The fre- 
quency of response Indicating performance of a task or utilization 
of a knoi^ ledge /skill is shown In the first four of the five 
coltmms of Table 32* An asterisk In the fifth column Indicates 
that the observed Chl-square value was significant at the .05 
level. 
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When comparing the RDDE respondents, significant C3ii- 
square values were observed for 40 out of 70 specified tasks 
(excluding "other", fill in the blank responses) and 88 out of 
93 specified know ledges /skills. (In fact, seventy- two of the 
one«hundred and twenty«eight significant Chi-*square values had 
probabilities of less than .001.) 

These findings, that 128 out of 163 variables showed a 
significant relationship between job function and whether or not 
the task was performed or the knowledge /skill utilized, indicated 
important differences among RDDE Job requirements. An exact 
interpretation of the differences among the job functions was dif- 
ficult to determine from the separate Chi-square tests, however. 

Table 33 presents a stnnmary of the data in Table 32. 
It indicates which job function groups or group were thought to 
account most for each significant relationship found between job 
function and task or knowledge /ski 11 variable. The groups indi- 
cated as accounting for most of the relationship were so designated 
because respondents from them did not perfonn the task or utilize 
the knowledge /skill to the extent thac respondents from other 
groups did. The groups accounting for the differences were deter- 
mined by inspection of the contingency tables. 

The synthesis of these differences is difficult since one 
cannot be sure of what significance the performance of one task 
or the utilization of one knowledge /ski 11 as compared to another 
has for defining the totality of RDDE activities. 



TABLE 33 



R, D, D, AND E FUNCTION CROITS ACCOmtNC FOR SlCNIiTCA?!! 
' DIFFERENCES IS TASK AND KNOVLEiXIES/SKILLS VARIABLES 

(N « 287) 





SUnlflcant Va 


risbles 


Cro 
ffl 


Account 
r Differen 


IM 

ca» 


Cluster Nmc 


Var* No. 


Ko» of 


R 


P 


p 


t 


Re«dint 


59 


I 




X 






Designing or Plsn* 
nlng Procedurcl 


65-75 












Activities 


76 


1 










Developing Restarch 
& InforMtlon 
GJtherlnc Tools 


78-82 


5 






X 




Collecting Project 


88-92 


5 










Data 


87 


I 








X 


Analyzing Data 


100-102 








X 






94-99 


6 




X 


X 




tfrlClng 


107.112 


2 






]^ 






113-lK 


2 








X 


Coordlnsting-People 


116 


I 








X 


Kee 1 1 nt /Cons u 1 1 ln<t 


131-132 


2 










Re search 


138-159 


22 






S 




Dev«lopsttnt 


171.17& 


2 












162-166.176-177 


7 


X 




J? 






175 


1 




X 


X 






167-169.172 


4 


X 




X 


X 


Disseninatlon 


179.181-186 


5 


X 








Deaonstration 


186-189 


4 


X 








Facilitating 
Adoption 


191-195 


5 


X 








Context Evaluation 


197-204.206^ 


9 






X- 






205 


I 


X 








Process Evaluation 


208-212 


5 


X 








Program P tannine 


214.216-221 




X 




X 


X 


OutcoM Evaluation 


223-228.232-238 


13 


X 




X 






3 


X 


X 


JL. 





Tfiaaa groups did iiot perfom the task or utilize knovledga/aklll to ttit 
extent tht other groups did. 
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In order to gain a better understanding of how job tasks 
and knowledges/skills cluster around RDDE functions, the cluster 
analysis, as reported in the next section, was performed. 

CLUSTER ANALYSIS 

To perform the job clustering analysis., the Computerized 
Occt:pational Data Analysis P^rograms (CODAP) system of the U.S. 
Marine Corps was used. 

The basic underlying procedure of job clustering in the 
CODAP system is the computation of an individual's percent rime 
spent on activities and comparison of these percents across indi- 
viduals and/or jobs. Table 34 provides a brief display of how 
these calculations are made. 



TABLE 34 

EXAMPLE OF CALCULATION OF PERCENT TIME SPENT ON TASKS 



Task 


Researcher 1 


Researcher 2 


De) 


/eloper 1 


Developer 2 


R* 


% Time 


R* 


Z Time 


R* 


% Time 


R* 


% Time 


A 


5 


62.5 


2 


13.4 


0 


0 


0 


0 


B 


3 


37.5 


3 


20.0 


0 


0 


0 


0 


C 


0 


0 


5 


33.3 


1 


33.3 


4 


44.4 


D 


0 


0 


5 


33.3 


2 


66.7 


5 


55.6 


Sum 


8 


100.0 


15 


100.0 


3 


100.0 


9 


100.0 



Assume the following rating scale (R) was used: 



0 « no part of work 

1 minor part of work 

2 « below average part of work 

3 » average part of work 

4 " above average part of work 

5 « very major part of work 
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The *7. Time" column Indicates the percent of total time 
spent on each task, the sum of those percents accounting for all 
of the person's time. To describe researchers and developers in 
the example, or any other Input groups, the CODk? system computes 
the average percent time spent on all tasks for all members in a 
defined group who perform the tasks and indicates the order in 
which time for the entire group is allotted to the tasks listed. 
Comparison of people within and between defined job function 
groups can then be shown in terms of which tasks or knowledges/ 
skills are performed or utilized to the greatest extent. 

For this study the CODAF system operated on groups of 
Tasks and Knowledges /Skills variables called "duty areas". These 
duty areas, alphabetically labelled from A to R in this study, were 
identified with terminology consistent with the broad general-area 
headings given to each set of Tasks and Knowledges/Skills. Table 
35 shows the list of these duty areas. Reference to Appendix F 
will give a complete itemization of which tasks and knowledges/ 
skills items were grouped into duty areas. 

Data from only the vocational and non-vocational field 
respondents who classified themselves in the R, D, D, or E func- 
tion were analyzed using the COOAP system (N«212). 

Tables 36 and 37 present the data on tasks performed for 
R, D, D, and E functions for the vocational and non«>vocational 
fields. Table 36 shows the ranking, based on cimiulative percent 
time spent by each functional group, for Task clusters A to I, 
for the combined vocational and non-vocational fields. 
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TABLE 35 
LIST OF "DUTY" AREAS 



Code 


No* Tasks 
In Duty 


Duty Title 


A 


6 


Reading 


B 


13 


Deslenlns or Plannlne Procedural Ai^t'lvlt'leii 


c 


7 


Gathering Tools 


D 


9 


Co 1 lec t 1m Pro lec t 


E 


11 


Analyzing and Interpreting Data 


F 


11 


Writing 


G 


7 


Supervising and Coordinating People and/or 
Resources 


H 


7 


Teaching or Training 


I 


8 


Meeting, Consulting or Advising 


J 


24 


Research Knowledges/Skills 


K 


17 


Research Based Development Knowledges/Skills 


L 


7* 


Diffusion Knovledges/Skills 


M 


5 


Demonstration Knoviedges/Skills 


N 


6 


Facilitating Adoption Knowledges /Ski lis 


0 


11 


Context Evaluation/Situation Analysis 
Knowledges/Skil Is 


P 


6 


Process Evaluation/Program Monitoring 
Knoir ledges/Skills 


Q 


9 


Program Planning/Input Analysis 
Knowledges/Skills 


R 


17 


Outcome Evaluation Knowledges /Skills 



Refer to Appendix F for complete list of tasks and knowledges/ 
skills grouped under each *'duty'' area* 
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Clusters (duties) B (designing or planning procedural 
activities), F (writing) , and I (meeting, consulting, or advising) 
were among the top four time-consuming duties common to all RDDE 
functions. Of the other top four time-consuming duties, cluster 
£ (analyzing and interpreting data) was common only to researchers 
and evaluators; cluster G (supervising and coordinating people 
and/or resources) was unique to developers; and cluster A (reading) 
was unique to diff users. Together » these top four duties accounted 
for 57% to 61Z of the total time spent on research- related tasks. 

Table 37 presents the data for the individaul RDDE func- 
tions within each of the vocational and non-vocational fields. 
Only within the diffusion and evaluation functions were some small 
differences noted in the percent of time spent performing duties 
(primarily clusters A and E) between the vocational and non- 
vocational respondents. Within the research and development 
functions the rankings were identical for both fields. 

In terms of Knowledges/Skills (clusters J to R) > Tables 
38 and 39 present the rankings of these clusters. The interesting 
fact revealed in Table 38 was that all four functional groups spent 
from 56% to 68% of their time utilizing Knowledges/Skills clusters 
J (research knowledges/skills) , R (outcome evaluation knowledges/ 
skills)) and K (research based development knowledges/skills). 
Only in cluster L (diffusion knowledges/skills) did the functional 
groups differ to some degree. 
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Table 39 displays the data for RDDE functional groups 
within each of the vocational and non«vocatlonal fields. As In 
Table 37, the rankings between vocational and non-*vocatlonal 
personnel within the diffusion function were slightly different » 
but the rankings within the research, development, and evaluation 
functions were almost Identical. 

The cluster analysis, therefore, showed a traiked similarity 
between the RDDE functional groups In terms of the percents of 
total time they devoted to the same task clusters and the time 
they utilized the same knowxedges/skllls clysters. 

NON^RESPOWDENT TELEHiOKE INTERVIEW DATA 

A telephone Interview was conducted for a stratified (by 
state) random sample of 100 Individuals, two per state^ selected 
from the list of non«>respondents to the mailed survey question^ 
nalres. 

Slxty«four persons were contacted, while 36 , no longer at 
the location given on the mall list, could not be contacted. 

Some persons did not answer all of the questions as asked, 
but of those who did, 38 Indicated receiving the survey corre* 
spondence, while 24 didn't; 14 persons returned the questionnaires 
(although the study never received them, probably due to loss In 
the mails) . Reasons given for not filling out the questionnaires 
Included (a) didn't have time (17), (b) didn't see value of survey 
(1), (c) questionnaire too long (4), and (d) other (6). 
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Thlrty-slx (56.2%) of the 64 Interviewees spent 25% or 
more time on RDDE activities, 25 (39.0%) spent less than 25%, 
while 3 (4.6%) had no reply. 

Table 40 presents the classification by educational field 
and job function of the telephone respondents. Place of work for 
the telephone Interviewees Is shown In Table 41, while highest 
degree held data Is shown In Table 42. With such small numbers 
of respondents. Tables 41 and 42 were not broken down by field or 
function. 

Inspection of the data from the telefdione Interview group 
with that of the mall«questlonnalre survey respondents on variables 
Indicating place of work, highest degree held, and educational 
field showed that the two groups were almost Identical. There 
were, however, proportionally more teachers and administrators In 
the telephone Interview group than there were In the malled- 
questlonnalre response population. 

There Is no reason to assume that the data from the mailed 
questionnaire respondents Is very much different from that which 
might have been obtained from the non-respondents (N«499) , except 
that the latter might contain a higher proportion of persons who 
classify themselves as teachers and administrators. 

SUMMARY 

This chapter provided a summary of the data collected 
(191,129 bits) for the study. With so many possible ways of com- 
bining and cross-tabulating available data, the chapter Is, In 
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TABLE 41 

PLACE OF WORK FOR TELEPHONE INTERVIEWEES 
(N = 36) 



Place of Work Number 


% of N 


Universities 16 


44.4 


Junior Colleges 2 


5.6 


Technical Institutes 1 


2.8 


R&D Centers 2 


5.6 


State Education Agencies 3 


8.3 


Regional Labs 1 


2.8 


K-12 School Districts 7 


19.4 


Other 2 


5.6 


No Response 2 


5.6 






TABLE 42 




HIGHEST DEGREE HELD BY TELEPHONE INTERVIEWEES 


(N = 36) 




Degree Number 


7. of N 


Doctorate 16 


44.4 


Specialist I 


2.8 


Masters 15 


41.7 


Bachelors 2 


5.6 


Associate 1 


2.8 


No Response 2 


5.6 
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some ways, rather short. Focusing on personnel wit:h research, 
development, diffusion, or evaluation functions within the voca- 
tional and non-vocational fields provided one means of limiting, 
reporting, and providing the information most pertinent to the 
objectives of the study. 

Anyone interested in performing additional analyses may 
contact the author for the data. 

Overall, the analyses provided evidence that vocational, 
non- vocational, and even part vocational part non-vocational (job 
field) personnel, are, for all practical purposes, not very dif- 
ferent from each other in terms of their general (personal) 
characteristics, in-service training, and job description. But, 
research, development, diffusion, and evaluation personnel in 
those fields are different from each other in terms of the pro- 
portions who perform certain tasks and who use certain knowledges/ 
skills. In terms of the time they devote to clusters of tasks 
and knowledges/skills, however, considerable similarity was 
revealed. 



Chapter 6 

SUMMARY AND CONCLUSIONS 

PROBLEM AND PROCEDURES 

The problem dealt with in this study was based on the lack 
of information for defining and describing Research, development, 
d^iffusion, and evaluation (RDDE) personnel and activities in voca* 
tional education. 

The purposes of this study were to identify RDDE personnel 
in vocational education, and to collect data describing those people 
and their jobs. 

Approximately 167 letters were sent requesting persons 
located in Research Coordinating Units, State Departments of Edu- 
cation, federal offices, R&D centers, corporations, foundations, 
professional education associations, etc. to identify vocational 
education RDDE personnel. Then, a search was made of a variety of 
indexes (e.g., ARM, AIM, RIE, Dissertation Abstracts) to gather 
names of persons possibly engaged in vocational education RDDE 
activities. And last, survey respondents from that "first approxi- 
mation population" were requested to indicate other vocational RDDE 
personnel in their geographic area. A total group of 1,962 persons 
possibly engaged in vocational education RDDE activities was thus 
identified. 
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A survey questionnaire was formulated to collect data about 
various characteristics of the group identified and their jobs. 
Questionnaire items about tasks performed and knowledges/skills 
utilized were taken from studies done in Colorado (Worthen and 
others, 1971) and Oregon (Schalock and others, 1972). 

Two forms of the questionnaire, one long-form (Appendix B) 
and one short-form (Appendix D), along with the necessary cover 
letters, instructions, and return^nail procedures and material ^ere 
developed. The long-form was the "first mailing" questionnaire 
\rtiich provided most of the data for the study. A first follow-up 
consisted of a "reminder-to-par ticipate" postcard (Appendix C). 
The short-form questionnaire was used as a second follow-up. A 
stratified (by state) random sample of 100 non-respondents was also 
interviewed by telephone to collect some basic information about 
the non-respondent group. 

Data i.rom the questionnaires were stmmarized using fre- 
quency tabulations, and, where appropriate, measures of central 
tendency and deviations. The Chi-square statistic was used with 
nominal data to make appropriate tests whenever cell frequencies 
permitted such tests. An additional analysis procedure, the 
Computerized Occupational Data Analysis Programs of the Marine 
Corps (Oats-Hills Consultants, 1970), was employed to compare 
groups of respondents in terms of the time devoted to clusters of 
job tasks performed and knowledges /skills utilized. 

The response rate to the questionnaires was quite good. A 
total group of 1,962 persons was surveyed, with 786 (40.07.) 
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returning fully completed questionnaires, and 344 (17.5%) returning 
questionnaires indicating that they spent less than 25% time on 
RDDE activities. Sixty-four persons (3.3%) were interviewed by 
telephone, 43 persons (2.2%) did not wish to participate, and 16 
(.8%) returned questionnaires after the deadline date for inclusion 
into data analysis. Two-hundred and ten persons (10.7%) could not 
be located by any practical means. No information was obtained 
from four hundred and ninety-nine (25.4%) other persons. 

FINDINGS 

Respondents to the questionnaires classified themselves 
according to educational field: 373 persons (47.4%) were in voca- 
tional education, 147 (18.7%) were in non«-vocational education, 
247 (31.4%) were part-vocational and part non-vocational, and 19 
(2,4%) persons provided no data. The fact that 147 persons, 
thought to be in the vocational education group identified them- 
selves as being in non-vocational education was an unexpected 
result, but did allow the study to perform comparisons between 
vocational and non-vocational personnel. It should be remembered, 
however, that the group of non-vocational educators employed in 
this study was not a random selection from a predetermined popula- 
tion. The extent to which this group is representative of the 
entire population of non- vocational RDM personnel is not known. 

The large number of personnel who indicated they were con- 
ducting activities which were partly vocational and partly non- 
vocational in nature lead to the conclusion that, although there 
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were different terms (e.g., vocational and non-vocational educa- 
tion) to describe the contextual, or subject matter, emphasis of 
a particular type of educational activity, there was a distinct 
problem in classifying one*s educational field too strictly. 

Of the total group of 1,962 people surveyed, 786 (40.0%) 
Indicated they spent 25% or more time on RDDE activities. One<- 
hundred and fifty-five (19*7%) of the 786 considered themselves 
either researchers, developers, dlff users, or evaluators in the 
vocational education field, while 57 (7.2%) respondents considered 
themselves either researchers, developers, dlffusers, or evaluators 
In the non-vocational field. 

One aspect of the data analysis described and compared 
respondents from the vocational and non-vocational fields. Very 
few differences were found between the two fields In terms of 
the proportion of time (as measured by percents) respondents 
devoted to nine clusters of job tasks and nine clusters of 
knowledges/skills (each cluster being composed of a number of 
related tasks or knowledges/skills variables) « The results suggest- 
ed that no important distinctions existed between vocational and 
non- vocational groups In terms of their job activities and the 
knowledges/skills clusters they utilized. 

One difference found between vocational and non^vocatlonal 
respondents, however, was their place of work. Whereas the non- 
vocational personnel were mainly located In Independent research 
agencies and state departments of education, a higher proportion 
of vocational personnel were located In technical Institutes, 
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research and development centers, research coordinating units, and 
federal agencies. Place of work (in addition to focus of problem 
areas) seemed to be the most important difference between the voca- 
tional and the non-vocational RDDE personnel who provided data for 
this study. 

A second aspect of the data analyses examined differences 
among research-related job functions— research, development, 
diffusion, and evaluation. This comparison revealed the most 
significant results of the study. Two-hundred and eighty-seven 
(36.4%) of the respondents classified themselves as either 
researchers, developers, diff users, or evaluators: 103 as re- 
searchers, 106 as developers, 26 as diffusers, and 52 as evaluators. 

These R, D, D, and E functional groups appeared to have 
similar characteristics on variables such as sex, age, degrees 
held, association memberships, majors, minors, in-service training 
needs and recent in-service training participation, and agreement 
with the definitions provided by the study, however, differences 
occurred in certain other general background information; in years 
experience in various defined areas, researchers as a group had an 
average of 18 years experience in other educational employment as 
compared to an average of almost 6 years for developers, 4 years 
for diffusers, and 5 years for evaluators. It is also interesting 
to note that the average number of years spent in the present 
employment position for all vocational and non-vocational RDDE 
personnel was 3.9 years, with diffusers being in the job an 
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average of 6 years, and developers, researchers, and evaluators 
being In the job an average of only 3.6 years. 

In terms of percent time spent in RDDE activities, the 
highest mean percent time was spent in the kind of activity whose 
title defined the function (e.g., researchers spent most of their 
time on research activities, developers in developmental activi- 
ties, etc.)> with the remainder of time spent on varied activities. 

Place of work also varied by job function. Proportionally 
most researchers were located in universities and independent 
research agencies; more developers were found in junior colleges, 
regional and K-12 school districts; more diffusers were located in 
professional education associations; and more evaluators were in 
technical institutes, state education agencies, and federal 
agencies. 

With regard to job products and services produced by the 
job, the diffusers produced more bibliographies than the other 
three groups; developers produced more training packages; evalup*- 
tors produced a greater proportion of survey designs/conducted 
surveys; and researchers produced a higher proportion of methodol* 
ogles. On other job products and services items, the four groups 
were similar. 

With respect to in-service training needs, the groups were 
generally similar with the exception that more researchers wanted 
research design and survey methodology training, more developers 
wanted survey methodology and measurement/testing training. 
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dlffusers wanted more administration/management training, and 
evaluators wanted program-planning-budgeting training. 

Although the above mentioned differences helped to dis* 
tinguish and describe the D, D, and £ groups, the major 
distinguishing factors found were those of specific job tasks 
performed and knowledges /skills used. The groups differed in the 
percent who performed 40 out of 70 specified tasks and who utilized 
88 of 93 specified knowledges /skills. The results seemed to Indicate 
that the four functional groups dealt with different tasks and 
utilized different knowledges /skills in their work. 

When the tasks were clustered and the functional groups 
were compared in terms of the average percent time devoted to each 
cluster of tasks, it was found that researchers, developers, dif- 
f users, and evaluators alike devoted most of their time to 
a) designing and planning procedural activities, b) meeting/con- 
sulting/advising, and c) writing. However, while researchers and 
evaluators also spent considerable time analyzing and interpreting 
data, developers supervised and coordinated people and resources, 
and diff users devoted more time to reading. 

In terms of clusters of knowledges /skills, all four groups 
spent a total of from 56% to 68% of their time utilizing a) research 
knowledges /skills, b) research-based development knowledges /skills, 
and c) outcome evaluation knowledges/skills. Only in terms of time 
devoted to diffusion knowledges /skills did one group (diffusers) 
exceed the other groups. 
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The findings of this study, as sunnnarlzed In the previous 
section 9 answered the questions posed by the stu<iy. Since the 
respondents who supplied the data cannot be considered a random 
sample from some population, no attempt was made to general- 
ize beyond the findings. Rather, the conclusions better serve 
to summarize the judgements of the author concerning the findings. 

First, the terminology us'*'^ ':o classify research-related 
personnel as being either In the vocatlon^il education or non- 
vocational (general academic) education fields was, at best, a 
means of Identifying the subject matter focus for their work and, 
perhaps, a means of indicating the institutional settings in which 
they conduct their work. It was not a meaningful way to distin- 
guish among research, development, diffusion, and evaluation 
personnel in terms of the nature of their activities. Comparison 
of the general (personal) characteristics of "vocational" and "non- 
vocational" education field respondents showed there were soid'^ 
differences, but none which would very meaningfully separate one 
group from another. In terms of the job tasks they perform and 
the knowledges/skills they utilize, the two fields seemed very 
similar. 

Second, there were distinct differences in the proportions 
of researchers, developers, diffusers, and evaluators who per- 
formed specific tasks and who utilized certain knowledges /ski 1 Is . 
However, the exact meaning of these differences for the purposes 
of identifying distinct research-related job functions needs 
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further investigation. The relationships between tasks performed 
and knowledges/skills utilized and other aspects of RDDE jobs, 
such as institutional settings , job outcomes, and jtrevious work 
ex'.^rience, also need to be studied* 

Third, there were a few recognizable differences between 
the RDDE functional groups when comparisons were made for the per- 
cent of time devoted to clusters of similar tasks. Howeve^, fewer 
differences were shown in percent time the groups spend utilizing 
clusters of similar knowledges /skills • 

Fourth, it appeared that identifying specific job out- 
comes, that is, products and services, may be a useful indicator 
of job functions and of what goes on in those functions. 



Chapter 7 
IMPLICATIONS AND RECCMMENDATIONS 

In llghC of the results of this study, several recommenda- 
tions can be made regarding further investigations and several 
implications drawn for RDDE training. 

First, It seems quite appropriate to suggest that more work 
be done to locate vocational RDDE personnel and to maintain an 
up-to-date locator list of them. Ef forte to create such a list, 
such as those which resulted In the National Register of Educa- 
tional Researchers, should be continued on a regular basis to keep 
It up-to-date. Not only would such a list make it easier for 
funding agencies to utilize the pool of RDDE personnel Interested 
In vocational education problems, but It would. If made available 
to all persons on the list, enhance the communications network In 
vocational educational RDDE. 

Second, more work Is needed to describe the tasks performed 
and knowledges/skills used In, and the outcomes of R, D, D, and E 
activities. Although first attempts have now been made (by the 
Colorado and Oregon studies and by this study) to define and gather 
data describing the work and the products of R, D, D, and E person- 
nel, there Is a need to refine the Information. 

Although we have the theoretical, conceptual, and flrst- 
tlme-data bases for discussing RDDE, widely accepted definitions 
and descriptions of R, D, D, and E activities are need so that the 
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differences and similarities between the R, D, D, end E functions 
can be fully understood. Such an understanding could be an 
Invaluable tool In determining which activity, R, D, D, or E, or 
combination of activities could best accomplish any one or several 
of the goals formulated to produce specific products and services* 

Third, the data from this study and the Colorado and Oregon 
studies should prove useful In the development of pre-servlce and 
In-servlce training programs for R, D, D, and E personnel. That 
Is to say, training programs should reflect, to a considerable 
degree, the skills currently needed In the "real world." Skills 
not being practiced, but which "should be", do have a place In 
planning training programs, but Is Is also Important not to neglect 
the realistic needs of the present roles, especially to the degree 
that those roles adequately attend to the functional requirements 
of the profession. For RDDE training programs to realistically 
train personnel for RDDE activities, to equip persons to rapidly 
become active and productive '"RDDE'ers", the programs must be 
reasonably consistent with extant job requirements, and should 
therefore reflect the results of this study, the Colorado study, 
and the Oregon study. 

Fourth, the results of this study imply that much of the 
pre-servlce training programs of all R, D, D, and E personnel may 
be common. The major differences among the four job functions are 
variations in emphasis and applications, while the major differ- 
ences between vocational and non-vocational personnel are in their 
substantive area of study. For these differences in emphases , 
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applications, and subject field, the training programs may have to 
concentrate on providing specialization for advanced research** 
related content as well as different opportunities to apply that 
content. 

Fifth, the need revealed by this study for in-*service 
training programs suggests that many such opportunities should be 
provided. Each in-service need should be met by having a number 
of training programs offered at various places throughout the 
country at various times throughout the year. It is difficult to 
judge whether it is lack of cime and money, lack of motivation, or 
lack of enough training programs which causes only 50% of the 
population surveyed to participate in these types of programs. But 
based on the self-professed need for in-service training, it seems 
probable those needs can better be met if arrangements can be made 
to provide programs which are conveniently offered, have relevant 
and challenging content, and reduce financial restrictions to a 
minimttm. The need for a constant updating of the knowledges and 
skills of the RDDE community is vitally important if the qualita- 
tive demands placed on its varied products and services are to be 
satisfied. 

In summary, it is quite necessary that the community of 
educational researchers, developers, diff users, and e valuators 
conduct investigations of their own activities with the end result 
of improving the quality of those activities. This study has been 
one of several attempts to study RDDE activities and personnel in 
order to provide information which may assist in their improvement. 
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ntSEAKCH COORDINATINC UNIT FOt VOTATIONAL EDUCATION 
14S PCU HAI L • MINNEArOLlS. MIMiNKkOTA $$4SS 

PROJECT STATUS (612) 376-7430 



July 30, 1971 



Dear 

During the coalng j€%t I will be condticcijig ■ USOE tponsored projtcc Co locate, 
and survey • nadon-wide population of peopla conducting research, development, 
diffusion, snd evaluation sctlvltles In vocstlonal-occupatlonsl (csreer) 
educstlon. 

This project will atteapt to locate these people and collect dsta concerning 
their roles, tssks, trslning, skills, knowledges, snd products and services. 
The dsta will help to describe the current ststus of vocstlonal RODE personnel. 

The biggest problea In the project Is locating the people. I would, therefore, 
sppreclate any ssslstance you sight be sblc to provide In locating that 
populat Ion . 

Of psrtlcular Intsrest to mt would be the naaes and addresses of people froa 
the below listed Institutions who sight be conducting RODE activities: 

1. RCU 

2* Ststa Oepsrtaent of Education 

3. Colleges snd Unlversltlss-publlc snd private 

4« Vocational Schools-public snd prlvste 

5. Industry snd Business 

6. Prlvste Founds t Ions and Professional Associations (directories, etc.) 

7. Eleaentary, Junior and Senior High Schools 

If you could provide ae with the naaes and sddresses (or where I could secure 
such Inforaatlon) of thoss paopls whoa you know or believe sre conducting soae 
RDDE sctlvltles In vocstlonal-occupstlonal educstlon It would b of treaendous 
help to ac. 

If you have any questions or coaaents sbout ths project please contact ae at the RCU. 
Thsnk you vary auch for your tlae snd cooperation. 



Sincerely, 



Paul E» Schroedar 
Project Director 



PES:rw 



142 

The letter content shown In this appendix is a generalized 
version of the requests for names sent to: 

1. state directors of vocational education 

2, professional associations 
3« research coordinating units 

4, foundations, Institutes, and government offices 

5. special individuals and organizations 

The general tone of the letters was similar. Slight 
changes were made in the format to reflect the nature and type of 
name- resource being written to. 
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RC^EARCH COORDINATING CMT FOR VOCATIONAL EDUCATION 
141 PClR HALL • MINNEAPOLIS. MINNESOTA SS4tS 

PROJECT STATUS (612) 376>7430 



November 30. 1971 



Dear Colleague: 

The enclosed questionnaire is psrt of s study to locate, collect descriptive data 
about, and compare peraonnel conducting Research, development, diffusion, and 
^valuation (RDDE) activities in both vocational and non-vocational education fields. 

The data reaulting from the study is designed to be used in making decisions concern- 
ing the planning and allocation of human, financial, and material resources for 
RDDE activities themselves, and pre-service and in-service training programs for 
educational RDDE peraonnel. 

If you 1) have spent an average of 25Z or more time in «ach of the past two years, or 
2) are now spending 25Z or more time on RDDE activities, please fill out the entire 
questionnaire. If you do not fall into either of the above categories please check 
the box in the upper left comer of page 1, answer questions 1 through 10 on page 3, 
and return the queationnaire. If you know of anyone in your local vicinity who spends 
2SX or more time on RDDE activities, please fill in question 27 on page 15 regardless 
of your time status. 

All individual responses are completely confidential and will be reported in 
statistical form only. Questionnaire code numbers are for computer identification 
only. 

I would appreciate your completing the questionnaire and returning it within one 
week. A stamped, addreased envelope is provided for your convenience. I will be happy 
to send you a susmtary of the results of the survey if you wish one; just check the 
box in the lower right comer of page 1. 

If you have any comments concerning the study, please note them on the questionnaire 
"comments" page or contact me. 

Thank you very much for your time and cooperation. 



Sincerely, 

Paul E. Schroeder 
Project Director 



PES/kw 
Enclosures. 



□ Chack Box if you apsnd iMt than 25X 
tlM on tODE activitlMy than anavar 
quaationa 1 through 10 on page 3, and 
itaa 27 on paga 15. 

lolaa. Taaka. Training. Skillat Knoifladtea. Producta. and 
In-Sarvlca Training Maada Invantory 
InatcuctiOM 

Tha purpoaa of thia inventory ia to gathar information about tha ac.ual back- 
grounda and opiolona of profasaional paraona vho parfom Reaaarch, DavalopMot, 
Diffuaion, and Evaluation <U>DI) activltiaa in both vocational and nott-vocatioaal 
education fialda. 

Plaaaa raapond aa candidly aa poaaibla. Tour raaponaaa will ba kapt confiden- 
tial and tha coapilationa aada froa thaaa invaatoriaa will ba reported in etetietlcel 
fora only. 

There are no right or wrong reepooaea and no preferred pattern of reaponae. 

Mark your reepooaee end coavente clearly end legibly end aake eny euppleaentery 
notetiona regarding pertinent inforaation in the urgine, the writing epecee provided 
for **other'* responeee* or on the "coaBante" page. 

If you 1) have epent en everege of 2SX or aore tiM in each of the peet two yeare, 
or 2) are now epanding 25S or aore tiae on IDDf ectivitiee, pleaee fill out the entire 
queetionaaire. If you do not fell into either of the above cetegoriee pleaee check 
the bOiC in the upper left comer &f thie pege, enawer queetiona 1 through 10 on pege 
3» end itea 27 on pege IS. 

Thenk you. * 



Check Box if you wieh e euaaMry 
of the reeulte of the eurvey. 



DEnHITIOMS USED IM THIS STUDY 



EducatlonMl RDDE : A coordlasced sec of •crsccgles which produce recognizable produces 
chec can be judged m Co chelr quellcy and their concrlbuclon Co che solution of sn 
educsclonsl problcai. 



Educstlonsl Kesssrch ; A coordlnsted set of scdvlcles which produce rslisble knowledge, 
chsc is, fsccs, principles, gsnsrslizscions, cheories, sad lews chsc cso scsnd the 
esse of eapiricsl verlficscioa. 



Educstlonsl Pevslopwent : A coordlnsted set of sctivlties which produce relisble 
technology, thst is, procedures, Mterlsls, hsrdwsre end orgsnlcstional frMcworks 
thst hsvs s known dsgree of succsss in bringing about s psrticulsr outcoae or In 
perforaing s defined opsrstion. 



fcducstionsl Diffuaion : A coordinated sst of sctivlties which Issd Co the sdoptlon 
snd/or utllixstion of gsnersllsable knowledge, reliable technology and trustworthy 
infornation. 



Educational Evaluation : A coordinated aet of activltlea which produce trustworthy 
infonution in aupport of deciaioa aaklng, that la, obaarvationa, reporta, and data 
derived through foraal or infonul Maauraa which are praaented to decision Mkera 
in a for« and within a tlM which penilta Ita utilisation In the dcciaion aaking 
proceaa. 



Vocational Education : Training, retraining, or upgrading which la given in achoola, 
claaaea, or other locationa (factoriea, atore front centara, etc.), including field 
or laboratory work and re«edial or related acada»ic and technical ioatruccion Incident 
thereto, under public or private (trade achoola, union progrsM, businaaa and industry 
prograaa, etc*) auperviaion and control or under contract with a atate or local 
education agency, and la conducted as part of a progvaa deaigned to prepare or upgrede 
individuala for gainful eaployaent aa aMiakllled or skilled workara or tachniciana 
or «ub-profeaaionala in racognixad occupationa and in ncv and eaerging occupatlona, 
or to prepare individuala for anrollMnt in advanced technical education prograaa, but 
excluding any program to prepare individuala for c^>loy«ent in occupations generally 
conaidarad profaaaioaal or which require a baccalaureate or higher dagraa. 



Manpower : Referring to or dealing with the paraona (their characterietice, cducetionel 
and training background, and aocio-aconoalc atatua) available for the production, 
Mnagaaant, profaaaional, and aarvica functions of an econoay. 



PERSONAL BAC KCRDUND SECTION 



INSTRUCTIONS: Check the line</ opposite each iten that applies to you, or write in the 
data required. 


1. Name 

Ust First Kiddle Initial 

2. Position or Title 
3> Business Address 
4. Institution Name 

3. City 6. State 7. Zip Code 
8. Telephone 9. Sex: Hale Female 10. A^e 


11. Check the degrees you hold 
Doctorate 

Specialist of Professional 

_ Masters 

Bachelors 

Associate 

Technical License 

None of these 

Other: 


12. National Professional Organization Memberships 

AERA (American Educational Research Association) 

^NEA (National Education Association) 

AVA (American Vocational Association) 

^APGA (American Personnel h Guidance Association) 

^APA (American Psychological Association) 

^AECT (Association of Educational & ConmuRications 

Technology) 

AIAA (American Industrial Arts Association) 

AVERA (American Vocational Educational Research 
Association) 

^PDK (Phi Delta Kappa) 

Other: 


Other: 




13. Major area of specialty for highest degree 
(check only one) 

Educ at ion/Teach ing 

Education/Administration 

Education/Pesearch 

Education/CurriculuM 

^Guidance/Counseling 

Vocational Education 

Statistica/Meaaurement/Tests 

^Psychology 

Sociology 

Engineering 

Ccaiputer Sciences 

English/Writing 

^HuMsnities 

Suslnesa Administration 

^Physical Sciences 

Biological Sciences 

Industrial Relations 

Other 


14. Minor areas of specialty for hlghei>t 

degree (check areas applicable) 
• Education/Teaching 

Education /Administration 

Education /Research 

Education /Curriculum 

Guidance /Counsel ing 

Vocational Educaticn 

^Statiaticfi /Measurement/Tests 

Psychology 

Sociology 

Engineering 

Computer Sciences 

English/Writing 

^Humanities 

Business Administration 

^Physical Sciences 

Biological Sciences 

Industrial Relations 

Other 
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15. Nuabar of yMxi of •xparlinee In Mch of the following arsM: 

Adalnlatratlon Conducting IDDE aetlvltlM Preitnt position 

Tnnchlng ^Con«ultntlon 

O thnr nducntlon«l MployMnt 

O thnr naployMnt (non-profnnnlonal •ducntlon)__ 



YOUR PIE5IMT JOB 



Pl«Mn clMslfy your prMnnt job according to Its najor cBphnsls. (n.g. gAsaarch IN Non- 
vocntlonal •ducatlon-'-currlculua) Uaa only ona clMslflcstlon In nnch coluan. Una the 
definitions of IDDI provided on pags 2 to halp classify your Job. 



16. Typs of Job Function: 

K asaarch (I) 

^Dovalopaant (D) 

^Dlffualon (D) 

E valuation (I) 
T aachlng/Tralnlng 
A dalnla t ra t lon/Maaagas 
Othar 



!Nj 17. Tha Flald of: 



^Vocational Education 
_Mott- vocational aducatlon 
Spacify ar«a_ 



_Part Vocational and part Mon- 
vocatlonal 



Coablnatlon of sbovs 



18. Plssss list ths porcantsgs of your tlao spsnt In esch of ths actlvltlss lis tad bslow. 
Uss ths dsflnltlona of IDDE provldsd on psgs 2 to halp you. List tha tlao according 
to ths following seala of Xtlaa spant: 0-OZ; 1«1-10Z; 2-11-20X; >21-30Zi 4-3>40E: 
5-41-50Z; i-5l-60E; 7-61-70Z; »-71-80Zs 9*81-901; 10-91- -fZ. 



_ltaaaarch 

^Evaluation 
_Taachlng/Tralnlng 



J)avalopMit piffualon 

^Adalnlat ratlon/aanagsMnt 
Othar 



(a.g. conaultlng) 



19. Plaasa chack ooa of tha following which boat dasslflas your placa of aaployaant. 



Unlvaralty or Collaga 

J unior or CoMunlty Collaga 

Tachnlcal Xnatituta 

t k D Cantor 

Indapandant laaaarch Agancy 

Stata Education Dapartnant 

l aglonal Lab 



^School Diatrlct (E-12) 

l aaaarfh Coordinating Unit 

P adaral Agancy 

Industry 

P rofaaalottal Education Aaaoclatlon 
Othar 



JOB TASKS 

20. Consider each of the following statements which may deacribe or characterise ta^ks 
which you msy perform in your work. As you consider each task: 1) consider whether 
the tssk appliea to your trork. If the anvwer ia NO, mark a "O" in front of that task: 
2) if the tssk does spply to your work, decide how significant a part of your work it 
represents. Consider and weigh its crlticalness, frequency of occurrence, relevance, 
or sny other fsctor which you think determines the extent to which thst task is 
performed in your work. 

You sre to sllot s vslue between 0 snd S to esch tssk sccordlng to the following 
scale: 

0. Definitely not s psrt of my work, does not spply. 

1- Under unususl circusMtanccs may be a mino r part of my work. 

2. 

3. A signiticsnt part of my work. 
4. 

5. A most significsnt part of my work. 

A. Reading. 

1. Reading recent project-relsted rcsesrch. 

2. Reading scholsrly esssys. 

3. Reading methodological documenta preaanting information regsrding methods of 

inquiry snd/or snalysis. 

4. Resding "in^house" materisls snd correspondence. 

5. Editing snd/or proofing of printed materisls. 

6. Other resding: 



B. !)esigning or plsnning procedursl sctivities. 

1. Identifying relevant vsrisbles for considerstion. 

2. Developing conceptual frameworks or genersl psttems of design. 

3. Developing methodologies to be used in projects. 

4. Orgsnizing s cohetent program of sctivities. 

5. Designsting sampling procedures. 

^6. Designating genersl ststisticsl trcstment to be used. 

7. Designing system modmls for computsr application to data. 

8. Formulating hypotheaea or queationa to be answered by resesrch. 

9. Determining constrsints to problem solution, such ss time, money, personnel, 

snd mariist fsctors. 
10. Developing budgets for tssks or projects. 

11. Plsnning snd/or making arrangementa for field teata, training, trial centera, 

demonatrationa, inatallationa, etc. 

12. Planning of behavioral, attitudinal, and/or learning change in some target 

group. 



_13. Other deaigning:^ 



C, Developing research tools or other inforaution-gathering instruments. 

1. Constructing questlonnsires. 

2. Developing test items. 

3. Developing interview outlines snd schedules. 

4. Developing observational techniques. 

S. Identifying appropriate meaaurea for eventa, variablea, or other measurement 

conce rna. 

6. Fabricating of phyaical items, such aa raaponae racrrdera, stimulus presen- 
tation devicea, room partitiona or furniture, prototype devices, etc. 
7. Other instrument developments: 
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D. Collecting project data. 

1 . I nte rviewing . 

2. Surveying literature. 

3. Conducting laboratory experiacnts. 

4. Adainiatering quaationnairca. 

5. Adainiatering teata. 

6. Pcrforaing aapecta of Job and/or teak analyaia. 

7. Deriving or otherviae verifying the aerit and/or relevance of student per* 

foraanca objactivea (behavioral objective*). 
8. Collecting and organlxing inforaation relevant to the preparation of a 

public inforvation, diaaeaination, product diatribution, or aarketing plan. 
^9. Other data collection: 



E. Analyzing and interpreting data. 

1. Preparing or using frequency tallies and/or aargioal diatributiona (aa in 

Chi-Squara testa). 

2. Coaputing or uaing aeasuraa of central tendency (i.e., aesns, aediana, aodea, 

arithaetic average). 

3. Coaputing or using correlation coefficienta, including aiaple correlational 

analyses. 

4. Coaputing and interpreting aiaple teata of aignificance of differences in 

obaerved data (auch a t-teata). 

S. Coaputing and interpreting data froa analyaia of variance dcaigna. 

f** Computing and interpreting regresaion snalyaes. 

7. Exsaining and interpreting non-quantified inforastion (auch aa verbal 

reaponsea, obaerved activitiea, etc.). 
8. Coaputing itea analyaea of teat iteas. 

9. Drawing lapllcations froa the results of prior reaesrch (interpret, eval- 
uate, and aynthesizc the relevant litersture). 

10. Anslyxiag thi% nature of various sudi*nces of "publics" to prepere appro- 
priate coaauni est ions . 

11. Othsr dsts snslysis: 



F. Writing. 

1. Writing correspondcncs. 

2. Writing research propossls. 

^ 3. Writing aajor project reports. 

4. Writing intsria, ststus, or periodic reports. 

S. Writing for professional pubXicstioas. 

6. Writing adainiatrative rcporta. 

7. Writing literature aurveya. 

8. Writing of coaputar progrsM for data handling or analyaia. 

9. Writing of prograaned inatruction outXinaa and/or f rases . 

10. Writing of dauiled lesson plans. 

11. Other vritiatr 



C. Supervising and coordinating actions of others, and/or of material resources. 
1. Procuring, selecting, and assigning project personnel. 

l. Establishing contact with and participation by other personnel or agencies. 

^ 3. Reviewing perfonunce of project personnel. 

4. CoMMjnlcatiog personnel evaluations to individuals. 

5. Scheduling project activities and/or using PERT scheduling. 
6. Allocating responsibilities to project personnel. 

7. Other ai^ervision: 



H. Teaching or training. 

I. Participating in classrooa instruction. 

2. Participating in conduct of seminars or workshops. 

3. Providing on'the**job training to individuals. 

4. De5igning appropriate lemming situations. 

5. Conducting deaonstratlons of development products before various groups, 

and answering questions asked by MMbers of the group. 

6. Preparing visual materials, such as films, slides, video tapes, visual 

teaching aids, etc. 

1. Other instruction- related activities ^ 



I . Meeting, consulting, or sdvising. 

I. Contacts with funding sponsor or monitor of project. 

2. Contact with higher agency management for review of project. 

3. Presentations made at professional meetings to communicate various as- 
pects of project activities or results. 

4. Meeting with visiting personnel from other agencies. 

5. Conferring with colleagues, staff, and/or students. 

6. Interacting directly with personnel of other agencies, such as for field 

tests, at trial learning centers, potential users of X ( D products, etc. 

7. Speaking before public groups or specific target audiences. 

8. Other participation in meetings: . 



J. Other general category of work: 



(specify and rate each specific activity you do) 



21. Consid«r mmeh of the follovint •fUmnU which mmy dMcriba kfiowlcdgM/akill* which 
you IMS in your work. As you couidar mBch •tateaent: 1) con«id<r whether the 
knowledgee/ekilU t^ly to you end your work. If Cho aiMWcr io NO, aark • "0" in 
frost of that oCotMMnt; 2) if cho knowlodtoo/okillo do apply to you and your work, 
dacida the axtmt to which you arc faalliar vith thea. 

You arc to allot a value batveen 0 end 4 to cech knowledgce/ekille etetcMnt 
according to the followinf ecele: 

0. Doee not epply* 

1. leeding knowledge of, little ekill. 

2. S o— whet leee then everegc ekill. 

3. SoMwhet Bore thea average ekill. 

4. Highly ekilled. 

RESEAICM SKILLS 

1- Drawing reeeerch iaplicetiooe fron reeulte of prior reeeerch etudice. 

2. Identifying end deliaeetiag eignificent raecercheblc problcae. 

3- Procuring end/or aeaaging reeourcee (aateriel end hu«aa) neceeeery to 

rcech reeeerch objcctivee. 

Interpreting, evelueting, end eynthceizing rclcvent litcreturc. 

3. Forauletiag hypotheeee or Mpiricel queetiona to be anewered by the 

hypo thee ie. 

6. Specifying deta or evidence necceeery for « rigoroua teat of the 

hypotheeie. 

7. Identifying the populetion to which rcaulu ehould be geoerelised 

ead a eei^le repreeenutive of thet populetion, uaing appropriete 
eaapling techniquee to draw the eaaple. 

rotwletlag eltemetive generelisations fro* predicted reeeerch 

outcoaee. 

9. Identifying appropriete research aathoda. 

10. Underetending axperlaentel, queei-esperlaantel, and other eyeteaetic 

epproachee to inquiry, and drating on eueh knowledge in deeignlng e 
reeeerch etudy eppropriete to the problea under coaeideretion. 

II* Applying the reeeerch deeign, recognisiogt expliceting end controlliag 

threeU to velidicy. 

12. Identifying cleeeee of behavioral ontcoaae for Meeur«fc.nt. 

13. Chooaing epccific verieblee and treeCMnte (where eppro 'iate) to 

be used. 

14. Selecting eppropriete techniquee of aeeeureMnt. 

IS. Developing aeeeuring inatruaente. 

16. Aeeeeeing the validity of outcoae aoeauree. 
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_17. 

_18. 
_19. 

_20. 

_22. 
_23. 

_ 1. 
_ 2. 
« 3. 

_ 4. 
_ 5. 
_ 

_ 7. 
_ 8. 
_ 9. 

_10. 

_14. 
15. 



Icfar to patt ^ ^or rating aealc. 

Ualng a varlaty of 4«ta*gatAarlfig »ethoda (tcata, InCervlwa, aulyaU 
of dociMients, ate.)* 

Organiilng data for analyaU. 

Uaderataodlng tba g^Mral roU, typaa, and aaauaptlooa uadarlylog 
varloua atatlatleal tacbniquaa, and draving on audi knowladga in 
aalactlag and uaing approprlata tachniquca of data analyala. 

Ualag aida in daU analyaaa, auch aa coapuUr procaaaing. 

Intarprating and dravlng appropriata concluaiona and Inplicationa 
froa data aa«lyaaa. 

Porvilating aUtaaaata of a theory tli«t offara an axplanation (cauac- 
affcct reUtionahip) of tha bahavlor undar atudy. 

teporting raaaarch flndinga and iivlicationa, orally and in writing. 
0 tha r : 

KKSEAiat/iASED l«VBLflPlgilT SKILLS 
(Including Product Taatlng) 

Intarprating infotaatlon concerning adueadon goala. 

Drawing on raaaarch raaulta in planning devalopaantal activitiea. 



Conceptualising ayatew, their cle 
theee eleaanta. 



nta» and incerreletione aaong 



Specifying deeired performance outcoMa (objaetliree) of Inatruction. 
Devieing technlquea to identify entry capabilitiae of leamere. 
Deecribing the product to be developed. 
Deceraining appropriate eequencee of topica in inetruction. 
Deecribing tha product to be developed. 

Coapoeing effective orel and written forae of inatructional coa- 
aunicatlona. 

Directing the work of production peraonnel. 

Selecting or devleing epproprleCe tedmlquei for aeaeuring outeoaee. 

Deeigning end aanaging initial laboretory taete of developed tech- 
niquee and aaUriele. 

Deeigning end aanaging field tryouCe end teete. 
Beporting evaluation of outcoaea. 
Interpreting eveluation findinge. 



■ERJC, 
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Refer to p«ge 8 for rating scale. 

l^ Specifying requlrenente for revision b««ed upon outcoae evaluation*. 

17. Other;^ 

DIFFUSION SKILLS 

Disseainstlon 

1. Defining uid analysing character la tics of target group (a). 

2. Selecting from all available information about developed packagea 

that which can be aoat effectively dlaa^nlnated. 

3. Selecting che moat effective dlaaaailnstlon vehicles to convey In- 

foraatlon to target groupa. 

4. CoB^>oslng Che InforsMtlon, wlchln s chosen fontat, for accurate and 

pervaalve dlaacalnatlon. 

^. Ivpleaientlng actual dlaaaalnatlon. Including th« direction of tech- 
nical production personnel. 

6. Designing and lttplc«entlng technlquea for evaluating the ef fectivenesa 

of the dlaaealnatlon effort. 

7. Other: 

Demonstration 

1. Specifying nature of the demonstration. 

, 2. Selecting appropriate aettlng and personnel for demonstrstlon. 

_ Mansglng and coordinating the demonstration effort. 

& Evaluating che effec clveneaa of the demonacraclon 

_ 5. OCher: 

Faclllcaclng Adopclon 

I. Idenclfylng faaCurea of Che adopclng organlzaclon or ayacem which 

differ from choae In tfhlch the produce waa developed and ceaced. 

Dealgnlng modlf IcaClons of Che produce Co fit the sdoptlng orgsn- 

ixsclon or syscem* when necesssry. 

\ Designing prodedures for modifying Che sdopclng syscem or orgsnl- 
zsClon CO fic Che produce* when necesssry. Including Che design of 
needed Crslnlng programs 

_ 4 Idenclfylng pocenclsl bsrrlers to Implementation. 

Devising and conducting long-range evaluation of the Inatallcd 

package. 



Ufar to page a for ratlnt ■caU*. 



6. Othar: 



OOMTEXT EVAUIATION/SITUATION AMALYSIS SKILU 



IdMitifying soal« of ih% •yatca. 

Aiaaaaing tha ■ocial rclavanca of those t^ala. 

Identifying valuan that nrn inpiicit in the tyttea %0»U, 

Identifying the neture of the etenderde or none the decieion-nekere 
will epply in interpreting the relevent dete which nay be provided. 

Clerifying end ex^liceting deeired outcoMe of the eyetea. 

Heeeuring current ectuel outcoaee of the eyetea through techniquee 
euch ee: 



_ 7. 
_ 8. 
^ 9. 
_10. 
11. 



(1) deaogrephic enAlyeie 

(2) eeonoaic Melyeie 

(3) peychoaetric «n«lyele 

(4) eyeteao eiulyeie 

(5) obeervetionel techniques 

Coapering ectual end intended eye tea outcoace to identify diecrep- 
enciM (neadi) which exiet in the eyetea. 

Bxpliceting the probleae thet create the neede end diegnoeing the 
ceuiM of theee probleaa. 

Helping eyetea pereonnel to develop objectivee which* if etteined» 
will eetiefy the neede or eolva the probloaa idantified ebove. 

Deaigning a aonitoring eyetea thet will provide contiaual date (of 
the type above) on the etetua of the opereting eyetaa. 



Others 



PlDCMg EVjUmAIIOW/PgOCIAH HQMITOmiC SKILLS 



1. Deaigning and eelectlag iadicetore of prograaa in educetional 
prograaa. 

2. Monitoring the prograa to detect davlationa froa daeign^or apeci- 
fied pvocadurae through techniquaa euch aa uaal^tmlw aaaaurae , 
eyetaaa eiialyeie» and obeervetionel techniquaa. 

3. Anticipating predicted berrlere and raaainlng alert to uaantici- 
pacad problaaa that threeten the euccaae of tha prograa. 

4. Providing iaaadiate feedbeck to prograa oparetora for their pea- 
eible uae in aaklng dacieiona about aedificationa of tha plan* 
procaduraa* or reaourca allecationa* 



lERLCi 
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Refer to page 8 for rating scale. 



5. Perceiving human relation problems that threaten the success of .-l«e program. 

6. Other: _ 



PROGRAM PLANNING/ INPUT ANALYSIS SKILLS 

1. Helping system personnel to apply criteria to lists of possible 
objectives in order to select those which are feasible within con- 
straints of the operating context. 

2. Helping system personnel to establish priorities for the selected 
objectives. 

3. Identifying and -clng alternative strategies for attaining the 
selected objectives. 

4. Identifying and rating available resources (human, material, and 
financial) and/or potential sources of support. 

5. Selecting a strategy for implementation. 

6. Seleci . a source of support or the available resources which will 
be UHed to implement Che program. 

7. Predicting the potential barriers to success in th? proposed course 
of action and judging the potential of the strategy for overcoming 
the eatinated procedural barriers. 

8. Identifying alternative tactics to implement selected strategy and 
choosing those that seem moat likely to succeed. 

9. Other: 




Ufar to pa|a 8 for rating acala. 

OUTCOME EVALUATION SKILLS 

1. Applylni approprlata daaigna to avaluatlon atudlaa. 

2. Oavaloplni lanaral crltarla and dealgnlni data collaetlon proea- 
durta for application In acaaurlni tha affactlvanaaa and afflclancy 
of axlatlni Innovatlva praetleaa. and producta, l.a.. alnlmum atan- 
darda and outcoaaa vhlch Indleata auecaaaful utllltatlon of praetleaa 
and producta • 

3. If naeaaaary, tranalatlng objactlvaa Into bahavloral cam* 

^ 4. Zdantlfylni altuatlona In which tha daal|catad bahavlor can ba 
obaarvad and racordad« 

3. Eatabllahlni ataadArda or noma for judflni vhathar objactlvaa hava 
baan nttalnad. 

, 6. lalactlni (or davalopln|) and using tachnlquaa of Maauraaant to 
ylald Inforaatlon ralavant to thaaa atandarda. 

7. Aaaaaalng tha validity of outeoM naaauraa. 

8. Collactlng and organltlng cha data praparatory to analyala. 

9. Salactlng an approprlata tachnlqua to analyte tha data. 

,10. Analytlng tha avldanca ylaldad by tha avaluatlon. 

11. Tudglng tha atrangtha And waaknaaaaa of tha plana and procaduraa 
aaployad for Mating tha projact objactlvaa. 

,12. Daddlng hotf Co axplaln tha outcoaa as a function of plana, pro- 
caituraa* and raaoureaa. 

,13. Daddlng what racomandatlona to Mka a* a raault of tha outcoaaa. 

14. BatlMCli^ tha potantlal iKpact of tha outcoaaa on tha problaa. 

IS* Providing auffldant Inforaatlon to cha daclaloft»aakar to anabla 
hla to dadda vhathar to continue, aodlfy, or taralnata tha activ- 
ity or procaaa avaluatad* 

16. Spadfylng changaa chaC naad Co ba aada In tha concaxc avaluaclon 
ayacaa dua co daclalona abouc prograa conclnuaclon. 

17. OChari 
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YOUR JOB PRODUCTS AND SERVICES 



22. Please chezk the different types of job ouccones (products and services) which you 
produce snd provide for others ss s result of your work. 



^Newsletters 

^Reports 

_Blbllogrsphles 

_Books 

_^Currlculum asterlsls 

^Hethodologles (trslnlng, snslysls, etc.) 
.Tests 
_Propo6sls 
Trslnlng pscksges 

Other 



^Consultstlon 

^Survey design/conducting 

Proposal review/writing 

Workshops/conferences 

Other 



__Other_ 
Other 



IN-SERVICE TRAINING 



23. Please check thoac Items which raflect vour percalved In-aervlce training needa* 
Specify topical area<a) If nacsaaaty. 



Statlatlca 



Research dealgo 

^Survey Methodology 

Mcaaur««ent/tastlnK_ 

^Writing technlquea_ 



Teschlng/trslnlng tschnlques_ 
Admlnlstrstlon 



Progrsa plsnnlng-budgetln^ 

_CoiKputers/progrsiMilng 

jOthsr 

"other 



26. Have you psrtlclpsted In sny in-servlce training progrsaw in the past yesr^ 
Yc8 No If YES, whst wss the toplcsl sres 



DEFINITIONS 



25. Plesse indlcste the degree to which you sgree with the definitions used In this 
study on psge 2. Circle one number for esch definition. 



Educatlonsl RDDE 
Educatlonsl Resesrch 
Educstlonal Development 
Educatlonsl Diffusion 
Educatlonsl Evslustion 
Vocstlonal Educstlon 
Hsnpower 



Dlssgree 

Strongly 

1 
I 
1 
I 
1 
1 
1 



Dlsagres 

2 
2 
2 
2 
2 
2 
2 



Aurec 

Undecided Agree Strongly 
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COWENTS AND EXPLAHATIOK S 

26. Plcue make any dealrcd or necessary coaaeiica or explanations about the questionnaire 
or specific lte«s. 



Please uae additional sheets If necessary, 

OTHERS COM DUCTING RDDE ACTIVITIES 

27. Please list the nsMS and addresses of those p«opl« In your iHMdlate geographic 
vicinity who you know are spending 2SZ or aorc tlae on IDBE activities. 



NAME ADDRESS 



Please uas additional sheets If necessary. 



Dear Colleague: January 14, 1972 

In early December you received a questionnaire from 
PROJECT STATUS designed to collect Information describing 
the job roles, tasks, skills, etc. of persons conducting 
Research, development, diffusion, and evaluation (RDDE) 
activities in vocational and non-vocational education fields. 

Although the questionnaire does take about 45 minutes of 
your valuable time to complete, the data you can provide is 
very important ! Basic data like that requested on the 
questionnaire is necessary for properly designed pre-service 
and in-service training programs for educational RDDE 
personnel* 

Would you, therefore, please fill out the questionnaire 
sent to you and return it to me. If you do not wish to 
participate, please return the questionnaire with a note 
indicating that and your name and address on page 3 of the 
questionnaire . 

Your assistance in collecting the data is greatly 
apprec la ted. 



Sincerely, 

Paul E. Schroeder 



145 Peik Hall, U of M 
Minneapolis, MN 55455 



nt%tA*Cn CCORDI^ATIKC VUlJ rOR VO<ATlONAL LDl/fATlO^ 
US rCfK HALL • MINNEAPOLIS. MINNESOTA SS4SS 



PROJECT STATUS (612) 376-7430 



February 11. 1972 



Dear Colleague: 

In December, 1971 or January, 1972 you received a survey questionnaire entitled Roles, 
Taslcs, Training, Skills, Knowledges, Products, and In-Service Training Needs Inventory . 
That questionnaire is part of a study to locate, collect descriptive data about, and 
compare personnel conducting jesearch, ^evelopaent, diffusion, and e^valuation (RODE) 
activities in both vocational and non-vocatiooal education fields. 

It is iaportant that this data be collected in order that an accurate current status 
report on educational RDDE personnel be Mde aid available for designing and conduct- 
ing pre-service and in-service training prograas for RDDE personnel. 

In order that the study collect data fron as Mny persons as possible vho have been 
identified as RIKNE personnel, I have enclosed a shortened version of the original 
questionnaire sent to you. This version takes about thirty (30) vlnutes to complete. 
I would appreciate your participating in the study by completing the questionnaire 
and returning it to me in the enclosed stamped, addressed envelope. If you do not 
wish to participate in the study, however, please return the questionnaire with a 
note indicating that and your name and address on page 3 of the questionnaire. 

I will be happy to send you a sumaury of the results of the survey if you wish one; 
just check the box in the lower right comer of page I. If you have any questions 
9r cosmwnts concerning the study, please note them on the questionnaire "coMents" 
page or contact mm. 

Thank you very much for your time and cooperation. Your assistance in collecting the 
data is greatly appreciated. 



Sincerely, 




Paul E. Schroeder 
Project Director 



PES/kw 



Enc losures 



□ Check Box if you apend leaa than 23Z 
time on RODE acciviclM, then answer 
qucationa 1 throufh 10 on pag* 3, and 
icaa 27 on page 9. 

iolaa. Taaka^ Training. Skilla. Knowladtea. Producta. and 
In-Sarvica Training Waada Inventory 
Inatructiona 

The purpoae of thla Inventory ia to gather infonation about the actual back- 
grouoda and opiniona of profaaaional paraona who per for* Reaearch, Oevelopacnt> 
Oiffuaion* and Evaluation (RDOE) activitiaa in both vocational and non^vocational 
education fialda. 

Plaaaa rcapond aa candidly aa poaaibla. Your rcaponaea will be kept confident 
tial and the coapilationa aadc f roa theae inventoriea trill be reported in atatiatical 
for* only* 

There are no right or wrong raapoaaca and no preferred pattern of responae. 

Mark your reaponaaa and co— a n te clearly and legibly and sake any aupplc«entary 
notationa regarding partioant infonMtion in the aargina. the writing apacea provided 
for "other" responaaa* or on tha "cowcnta** page. 

If you 1) have apant an average of 23Z or mre tiae in each of the paat two yeere, 
or 2) ere now apanding 2SZ or aore tlae on RODE activitiee, pleaae fill out the entire 
queationneire. If you do not fall into either of Che above catagoriee pleaae check 
the box in the upper left comer of thia pege. eoawer quest iona 1 through 10 on page 
3, and icaa 27 on page 9. 

Thenk you. 



Check iox if you wieh e ewHary 
of tha reaulte of the eurvey. 
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PEmmoiS USED m this snror 



Educational MDPg ; A coordinated Mt of itratAglM which produce recognizable producta 
that can be Judtad aa to chrlr quality and thalr contribution to the aolutlon of an 
educational problea. 



Educational ieaaarch ; A coordinated aet of actlvltlea which produce reliable knowledga, 
thnt la, facta, prlnclplaa, generalize tlona, theorlea, and leva that can atend the 
teet of enplrlcal verification. 



Educetlonel Develognent ; A coordinated aet of actlvltlea vhlch produce reliable 
technology, thet la, procedurea, aaterlale, hardvare and organizational frTirprVi 
that have a knom degree of aucceea In bringing about a particular outcone or in 
perfomlng a defined operation. 



Educetlonel Plffualon ; A coordinated aet of actlvltlea which lead to the adoption 
and/or utlllsntlon of generellsabla knowledge* reliable technology end truatworthy 
Inforaatlon. 



Educational Eveluetlon ; A coordinated aet of ectlvitlea which produce truetworthy 
Inforaatlon In aupport of declalon aafclng, that la, obaervatlooa, reporta, end data 
derived through foraal or Inforaal aeaourca which are preaented to declalon aekers 
In a fom and within a tine which pcc^ta ita utilisation in the declalon waking 
proceea. 



Itecetlonnl Education ; Trailing, retraining, or upgrnding vhlch la given in acboola, 
cleseea, or other locationa (fectoriee, a tore front eentera, etc.), including field 
or l^ratory work end resediel or relaied aradanic and technical ina traction Incident 
thereto, under public or private (trade achoola, union prograaa, buaineaa and indue try 
prograM, etc.) aupecvlelon and control or under contract with a atate or local 
education agency, and la cond u c t ed ae part of a prograa deaigned to prepare or upgrade 
indlvlduala for gainful enpleynent ee aealakllled or akllled workera or technidena 
or aub*profeeaionala in recognised occupationa and in new and energing occupatlona, 
or to prepare individuela for enrollaant in advanced technical education prograna, but 
excluding any prograw to prepare Indlvlduala for e^loywnt in occupationa generally 
conaidared profeaaional or which require a baccalaureate or higher dagree. 



Hanpower ; lefarrlng to or dealing with the peraona (their rharactariatlce, educational 
and training background, and aodo-acononic atatua) available for the production, 
nanaganent, profeaaional, and aarvlca functlona of an aconoqr. 



PERSONAL BAncCROUWD SECTION 
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INSTRUCTIONS' Check the linej/oppoilce each icen that applies to vou, or write in the 
data required. 



1. Nane 


taat 




First Middle Initial 


2. Poaltlon or Title 






3. Business Addresa 


U. Institution Nane 






5- City 


6. State /Ip Code 


8. Telephone 


9. Sex: 


Hale Female 10. Aee 




11. Check the degrees you hold 


12. National Profeasional Organization Mei^ership» 


Doc tors te 


AERA (Aaerican Educational Research As»ociallon) 


Specialist of Professional 


^NEA (National Education Association) 


Masters 


AVA (Aiterican Vocational Association) 


Bachelors 


APGA (Anerican Personnel k Guidance Association) 


Associate 


APA (Asierl,can Psychological Association) 


^Technical License 


AECT (Association of Educational & Conmunications 


None of theae 


Technology) 


Other: 


AIAA (Anerican Industrial Arts Association) 




AVERA (American Vocational Educational Rpsearc'i 




Association) 




PDK (Phi 


Delta Kappa) 




Other: 






Other: 




13. Major area cf specialty for hlgheat degree 


14. Minor areas of specialty for highest 


(check only one) 




degree (check areas applicable) 


Edtic at Ion/Teaching 




Education/ reaching 


Education/Adiainia t ration 




Educs tl on/Adsiin is t ra t ion 


Educa t Ion/ Research 




^ Education/Research 


^Educat ion/Curriculun 




Education/Curriculum 


Cuidance/Counaeling 




^Guidance/ Counsel Ing 


Vocational Education 




Vocational Education 


S tatiatica /Heaaurcflwn t /Tea t s 




Stat is tics /Me asureacnt /Tests 


Paychology 




^Psychology 


^Sociology 




Sociology 


En gi nac r ing 




Engineering 


Conputer Sciences 




Cosiputer Sciences 


English/Writing 




English /'Writing 


^Hmunlties 




^Humanities 


Business Adalnistration 




Business Administration 


Phyalcal Sclancea 




^Physicsl Sciences 


Biological Sciances 




Biological Sciences 


Induatrial Ralations 




Industrial Relations 


Other 




Other 
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15. Nuabcr of ymzm of axptrlcncc In Mch of thm follovlng araaa: 

AdalnUtratlon C ondiictlng XODE actlvltlM 

Teaching ^ConaulUtlon 

jOthcr educatlonnl MployMnt 



_PrMant position 



Other eaplo]fBmt (non-prof«aalonal education}^ 



YOUR PIESBHT JOB 



PlMsa clMslfy your preatnt Job According to Its Major MphuU. (e.g. Reeeerch IN Non- 
vocetlonel •ducetlon*-currlculuB) Uee only one cleeel fleet Ion In eech coluwi. UeeThe 
definitions of RDDE provided on pege 2 to help cleselfy your job. 



16. Type of Job Function: 

leeeerch (X) 
O evelopaent (D) 

Mffuelon (D) 

^Bveluecion (E) 

Teechlng/Trelnlng 

A dalnletretlon/Heneti 

^Other 



ntj 17. The Field of: 



I 



_Vocetlonel Educetlon 
_lloD-vocetlonel educetlon 
Specify ere«^ 



_Pert Vocetlonel end pert Hon- 
vocetlonel 



Coablnatlon of ibove 



18. Fleeee llet the percentage of your tlM epent In eech of the ectlvltleo lleted below. 
Uee the definition* of KDOE provided on pege 2 Co help you. Llet the tlM ec cording 
to the following ecele of Xciae epent: 0-OX; 1-1-lOX; 2-11-20X: >21-30X; 4-31-AOX: 
5-41-50%; 6-51-60%; 7-61-70%; 6-71-80%; 9-81-90%; 10-91- +%. 



_Reeeerch 

_Eveluatlon 
_Teecblttg/Trainlttg 



_ P eve lopaent 

A dainletretlon/Banaeenent 

Other 



Diffuelon 



(e.g. conaultlng) 



19. Pleeee check one of the following which beat claaalflee your place of eiqiloyaent. 



^Unlverelty or College 

Junior or Coaeunlty College 

Technical Institute 

% 6 D Center 

^^Independent lesearch Agency 

S tate Educetlon Depertnent 
Xsgloaal Lab 



^School Dlatrlct (K-12) 

Reeeerch Coordinating Unit 

Federal Agency 

Industry 

P rofessional Education Aasoclstlon 
pthsr 



lERiq 



20. Consider each of the following aCACeiMncs which nay describe or charscterlze task/ 
which you My perforn in your work. As you consider esch task: 1) consider whether 
Che cssk spplias to your work. If the snswsr is NO, mark s "0" in front of that task; 
2) if Che cask doea apply Co your work» dacide how significsnc a part of your work 
ic repreamca. Consider snd weigh ics cricicslness. frequency of occurrence* 
relevsnce. or sny ocher fsccor which you chink detaralnes the extent to which you 
perfora chat cssk in your work. 

You sre Co slloc s vslus between 0 snd 5 to each cssk sccording co the 
following scsla: 



0. Definitely not s psrc of wy work, does noc spply. 

2. Under unusual circuucsoces nay ba a minor pare of my work. 
2. 

3. A Lignificaoc pare of ay work. 
A. 

5. A iioat aitnificant part of «y work. 



A. leading 

B. Deaigning or planning p*-ocedural acclvlcies. 

C. Developing research coola or ocher infonnaCion-gaChering instruiifnca. 

D. Colleccing projecc daca. 

E. Analyzing and incerprecing daca. 

F. Writing. 

C. Superviaing and coordinating actions of other persona, and/or of 
aacerial reaourcea. 

B. Teaching or training. 

I. Meeting, conaulcing. or adviaing. 

J. Other general caccgory of work:^^ 



X. Other general category of work: 
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p KMOULEPCK/SKIUiS 

21. Cor^lder aach of tha follavlng atatoMnta vhlch My daacrlbe knowledge«/akllla vhich 
you uaa In your vork. Aa you conaldar each atatCMnt: 1) conaldar vharher the 
icnovladgaa/akllla apply to you and your work. If tha aiwvar la NO, aark a "0" In 
front of that atataaant; 2) If the knowledgea/aUlla do apply to you and your work, 
decide the extent to vhlch you ere faalller/ekllled vlth thea. 

You ere to allot e velue bcttfeeo 0 end 4 to each knowledgea/ekllle etetcsent 
eccordlng to the follovlng ecal«: 

0. Xk>ee not epply. 

1. Reeding knowledge of, little eklll. 

2. SoMifhet leae than everege ekill. 

3. Soaewhat mov than everage eklll. 
A. Highly ekllUd. 

1* Identifying end delineating elgnlflcant reecarchable probleaM. 

2. Procuring end/or Managing rcaourcae (naterUl end human) neceaeery to reech 

reeearch objectlvea. 

3. Interpreting, evaluating, end eynthealslng ralevent lltereture. end drawing on 

reaearch raaulte in plenning deyalopMntel ectlvltlee. 

4. Forwiletlng reaearch-dlrecting hypothaaee or queetlona to be enawered by e etudy. 

5. Identifying the populetlon to which raaulta ehould be generalised end e saaple 

repreeentetlve of that populetlon, end ualng epproprlete eaapllna technlquee 

to draw e eaaple. 

6. Identifying approprlata reaaarch aethode, chooelng e reeeerch deelgn epproprlete 

to the problea under conaldaretloa, end epplylng tite reeeerch deelgn, 

recognising end controlling thraate to velldlty. 

7. Chooelng epaclflc verlablea and traatnante (where approprUtc) to be uaed. 

fl. Identifying, eelectlng* end ualng epproprlete etetletlcal technique! In 

enalyzlng date, «nd Interpreting and drawing appropriate conclualona end 

lapllcetlona fros data enalyeea. 
9. Uelng aids In deca eaalyeea, auch ee coaputer procaselng. 

10. FocauUtlng generalisations or etatsswote of e theory thet of fere en explenatlon 

(ceuaa-effact relatlonahlp) of the behavior under etudy. 
Reporting reaearch flndlnga and lapllcetlona, orelly, grephleelly, end In 

writing. 

12. Developing Inatructlooal eyetaaa, their elesMnte, end loterreletlons aw>ng 

theee eleaante. 

Specifying dealred perforaance outcoaaa (objectlvee), an<l eetabllehlng 

etendarde or aor«a In judging whather -^bjectlvea have been attelned. 

14. Chooelng epproprlate Inatructlonal end aedle technlquee In developing 

educetlonal producte and/or procaaeea. 

1^5* Deteralnlng approprleta eequancea of toplce In Inatructlon. 

16. Developing producte baaad on effective orel end written forae of Instructional 

coBiunicetloos. 

17* Deelgnlng end Managing field tryoute and teate. 

^18. Reporting evalustlon of outcomes and epaclfylng raqulramente for revlelon beeed 

upon outcoaa eveluatlon. 

19. Defining end anslyclng cheracterletlce of dleeealnatlon terget group<e). 

20. Salectlng, froa ell evr^lsbla inforaatlon about davelopad packagaa, that which 

cen be aoet effective, dleeenlnatad. 
21. Coapoelng Inforaatlon, within chooaaa foraat, for eccurata end pervealve 

dleeealnatlon. 

22. Salectlng tha noet effective dleeealnatlon vahlclea to convey inforaatlon to 

terget groupe end laplaaentlng ectual dlaeMlnaCloa. 



i 



i 
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^23. Ocalgnlng and iBpleaandng cachnlquca for evaluating affacclvenesa of 

dlataalnaclon, de«onacraclon, and Inacallatlon of educadonal producta or 
cachnlquaa. 

Ik, Salactlng approprlaca accclng and paraonnel for deiionatratlon, and nanaglng 

and coordinating tha deaonatratlon affort. 
_25. Identifying faaturea of adopting Inatltutlona different froa thoae setlinga 

In trhlch product waa developed end teeted. 
26. Oeelgnlng Modlflca^lone of producte to fit Inetltutlonal eettlnge, when 

neceeeery end/or dealgnlng proceduree for u^odlfylng the edoptlng Inetl tut lone 
to fit » o<i*icte, when neceeeery. Including the deelgn of epproprlate 
trelnln^ prcgrene. 

,27. Zden^ifyl'ig &oele of educational eyeteaa, eeeeeelng the aoclel relevence of 
thoee gcele, end Identifying velu«e thet ere lapllclt In the ayaten goels. 
28. Identifying the nature of etenderde or norma declelon-nekere will epply in 

Interpi'-clBg relevent dete which say be provided 
,29. Co^)erlng ectuel end Intended eyetea outcomea to Identify diecrepenclee 

(naede) which exlet In the eyetea. 
,30. Helping eyetea pereonnel to (1) develop objectlvee which. If etteined, will 
eatlefy the r<.ede or eolve the probleae Identified, end <2) eeteblleh 
prlarltlee eaong thoee objectivee. 

31. Deelgnlng e context aonltorlng eyetea thet will provide continual data, on 
the etetue of educetlon eyeteae. 

32. Identifying end retlng eltematlve etretegiee for etteinlng the selected 
objectivee end Identifying elternatlve tectice to lapleaert aelectad 
etretegy end chooelng thoee thet eeea noet likely to succeed. 

33. Identifying potentlel berrlere to edoptlon of educetlonel Innovetlone or 
berrlere to eucceee In propoeed courees of action and Judging the 
potentlel of etretegiee for overcoalng theee estimated procedurel 
ectlvltlee. 

34. rtonltorlng educetlonal progruw to detect: (e}devietlone froa deeign or 
epedf le i proceduree* end <b} unentldpeted probleae that threeten the 
eucceee of the prograa. « 

35. Providing laaedlete fcedbeck ebout perfor»ince of educetlonel progreaa 
to prograa oparetore for their poeelble use In aeklng decleione ebout 
■odiflcetlone of the progreae, nroceduree, or reeource ellocetlons. 

36. Applying epproprlete deelgne to eveluatlon etudlee. 

37. TraneleClng objectivee Into behevlor^'l {erne end Identifying eltuetlone In 
which the dcelgneted t^hevlor cen be obeerved end recorded. 

38. DeelgnlnT end eeWcting Indicator of progreee In educetlonel eysteas. 

39. Identifying end aeeeurlng ectun^ o ,tcoaee of eyeteae end eelectlng or 
devielug epproprlete technique ;^r aeeeurlng outcoaee. 

40. Other 



41. Other 



TOUR J0% PRODUCTS AHD SERVICES 



22. Plataa chack th« dlffarant typta of job outcoMo (product* and aervlcaa) vhlch you 
protfuoTaad provlda for othara aa a raault of your work. 



_NawaIattara 

_Blbllographlaa 
__Booka 

^Currlculua aatarlaU 

3fathodoloslM (training, analyaia, ate.) 

_Propoaala 
^Training packagaa 

"Othar 



jConaultation 

_Survay daaign/conducting 

_^Propoaal rcviav/vriting 

Jforkahopa/confarancaa 

J)thar 

^Othar 

"Otha r 



IN-SEIVICE TRAIMIMC 



23. Pleaaa check thoaa ittaa tfhich raflact your percaivad in-aarvica training ncada. 
Spacify topical araa(a) if nacaa^ary. 



^Statiatica 

_Xaaaarch daaign_ 



_Surv«y Mthodology 

^Hauuraaant/taatin^ 
"writing tachaiqu«a_ 



Jtaaching/training tachniqu«a_ 
"Adainiatration 



_Prograa planning-budgatin^ 

^Coaputart/prograaBlng 

"Otha r 

"Othar 



24. Have you participated in any in-aarvlcs training prograaa in tha paat yaarf 
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APPENDIX H 

Statistical Formulas Used In SPSS Computer Program 



Chi-Square (Pearson's Chi-Square test for Association) 




(r*l)(c-l) degrees of freedom 

f^ = observed frequency in each cell 
o 

f^ = expected frequency in each cell 

c » number of columns 
r = number of rows 



c^ » frequency of respective column margina 
r^ » frequency of respective row marginal 
N = total number of valid cases 



f is calculated by: 





e 



N 



Phi (for 2x2 tables) 



0 



N 



Cramer's V (for non 2x2 tables) 



Fisher's Exact Test 



201 



P. » 



NUIblcld: 



- frequency total for row 1 
» frequency total for row 2 

- frequency total for column 1 
^ frequency total for column 2 

aybyC,d ~ frequency of cell ayb,c,d respectively 
(assuming cells are lettered according 
to the following diagram) 



a 


b 


c 


d 



^1 



^1 ^2 



N -""total number of valid cases 



APPENDIX I 

Example of CODAP Computer Program Printout 



